2024-09-21T06:50:25.718 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T06:50:25.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:50:25.822 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913577 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/recovery-fs} email: pdonnell@redhat.com first_in_suite: false job_id: '7913577' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+DpooFHDcGuSzv4WDQIupHUDVikLNJoNiv3mME8bruShy6hGpyieQERjf/UpNvz3eFvB/FsS88/reUxKMx+SY= smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMpX1Ta/1FFvfCVllxSTADrG7JawjikN/FeOaViLwGGLjRRNCy8nFC1Zaf9nxYtfr5f71pO9bsvGWQZNq9JVJ0k= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_recovery_fs teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T06:50:25.822 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T06:50:25.823 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T06:50:25.823 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T06:50:25.824 INFO:teuthology.task.internal:Checking packages... 2024-09-21T06:50:25.845 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T06:50:25.845 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T06:50:25.845 INFO:teuthology.packaging:ref: None 2024-09-21T06:50:25.845 INFO:teuthology.packaging:tag: None 2024-09-21T06:50:25.845 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:50:25.845 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:50:25.845 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:50:25.986 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T06:50:25.988 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T06:50:25.995 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T06:50:25.995 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T06:50:26.037 INFO:teuthology.task.internal:Saving configuration 2024-09-21T06:50:26.054 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T06:50:26.063 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T06:50:26.085 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913577', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:45:28.292419', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+DpooFHDcGuSzv4WDQIupHUDVikLNJoNiv3mME8bruShy6hGpyieQERjf/UpNvz3eFvB/FsS88/reUxKMx+SY='} 2024-09-21T06:50:26.107 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913577', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:45:28.290722', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMpX1Ta/1FFvfCVllxSTADrG7JawjikN/FeOaViLwGGLjRRNCy8nFC1Zaf9nxYtfr5f71pO9bsvGWQZNq9JVJ0k='} 2024-09-21T06:50:26.107 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T06:50:26.114 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-21T06:50:26.115 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-21T06:50:26.115 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T06:50:26.173 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f31da180160>, signals=[15]) 2024-09-21T06:50:26.173 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T06:50:26.181 INFO:teuthology.task.internal:Opening connections... 2024-09-21T06:50:26.181 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:50:26.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:50:26.260 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T06:50:26.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:50:26.336 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T06:50:26.344 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-09-21T06:50:26.362 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-09-21T06:50:26.362 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-09-21T06:50:26.420 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-09-21T06:50:26.420 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9" 2024-09-21T06:50:26.420 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-09-21T06:50:26.420 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:50:26.420 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9" 2024-09-21T06:50:26.421 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:50:26.421 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:50:26.421 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-09-21T06:50:26.421 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:50:26.421 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:50:26.421 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:50:26.421 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:50:26.421 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:50:26.421 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:50:26.422 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-09-21T06:50:26.535 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-09-21T06:50:26.553 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-09-21T06:50:26.554 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-09-21T06:50:26.612 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-09-21T06:50:26.612 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-09-21T06:50:26.612 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-09-21T06:50:26.612 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:50:26.612 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-09-21T06:50:26.612 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:50:26.612 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:50:26.612 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-09-21T06:50:26.612 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:50:26.612 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:50:26.613 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:50:26.613 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:50:26.613 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:50:26.613 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:50:26.613 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-09-21T06:50:26.636 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T06:50:26.653 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T06:50:26.686 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T06:50:26.686 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:50:26.688 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:50:26.705 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T06:50:26.711 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T06:50:26.711 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:50:26.746 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:50:26.775 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T06:50:26.833 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T06:50:26.847 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T06:50:26.847 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-21T06:50:26.848 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-21T06:50:26.848 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:50:26.848 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:50:26.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:50:26.865 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-21T06:50:26.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:50:26.866 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-21T06:50:26.923 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:50:26.923 INFO:teuthology.task.kernel:Running kernel on smithi063: 5.14.0-503.el9.x86_64 2024-09-21T06:50:26.923 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum install -y kernel 2024-09-21T06:50:26.924 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:50:26.924 INFO:teuthology.task.kernel:Running kernel on smithi071: 5.14.0-503.el9.x86_64 2024-09-21T06:50:26.925 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum install -y kernel 2024-09-21T06:50:30.438 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.3 MB 00:01 2024-09-21T06:50:30.861 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.3 MB 00:02 2024-09-21T06:50:32.197 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-21T06:50:35.228 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 20 MB 00:03 2024-09-21T06:50:36.572 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-21T06:50:38.040 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-21T06:50:38.844 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-21T06:50:41.420 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-21T06:50:42.921 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 83 kB/s | 19 kB 00:00 2024-09-21T06:50:43.808 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T06:50:44.191 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T06:50:46.098 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:50:46.098 INFO:teuthology.orchestra.run.smithi071.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:50:46.206 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-21T06:50:46.210 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-21T06:50:46.210 INFO:teuthology.orchestra.run.smithi071.stdout: Package Architecture Version Repository Size 2024-09-21T06:50:46.210 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-21T06:50:46.210 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-21T06:50:46.210 INFO:teuthology.orchestra.run.smithi071.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:50:46.210 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-21T06:50:46.210 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:50:46.210 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:50:46.210 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:50:46.210 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:50:46.210 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-21T06:50:46.211 INFO:teuthology.orchestra.run.smithi071.stdout:================================================================================ 2024-09-21T06:50:46.211 INFO:teuthology.orchestra.run.smithi071.stdout:Install 4 Packages 2024-09-21T06:50:46.211 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:50:46.211 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 79 M 2024-09-21T06:50:46.211 INFO:teuthology.orchestra.run.smithi071.stdout:Installed size: 126 M 2024-09-21T06:50:46.211 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-21T06:50:46.334 INFO:teuthology.orchestra.run.smithi071.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 458 kB/s | 36 kB 00:00 2024-09-21T06:50:49.464 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 9.9 kB/s | 1.7 kB 00:00 2024-09-21T06:50:50.359 INFO:teuthology.orchestra.run.smithi071.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-21T06:50:51.522 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:50:51.522 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:50:51.618 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-21T06:50:51.625 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-21T06:50:51.625 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2024-09-21T06:50:51.625 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-21T06:50:51.625 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-21T06:50:51.625 INFO:teuthology.orchestra.run.smithi063.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:50:51.625 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-21T06:50:51.625 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:50:51.625 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:50:51.625 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:50:51.626 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:50:51.626 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-21T06:50:51.626 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-09-21T06:50:51.626 INFO:teuthology.orchestra.run.smithi063.stdout:Install 4 Packages 2024-09-21T06:50:51.626 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:50:51.626 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 79 M 2024-09-21T06:50:51.626 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 126 M 2024-09-21T06:50:51.627 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-21T06:50:51.757 INFO:teuthology.orchestra.run.smithi063.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 436 kB/s | 36 kB 00:00 2024-09-21T06:50:53.575 INFO:teuthology.orchestra.run.smithi071.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.9 MB/s | 29 MB 00:07 2024-09-21T06:50:54.790 INFO:teuthology.orchestra.run.smithi063.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 9.4 MB/s | 29 MB 00:03 2024-09-21T06:50:55.401 INFO:teuthology.orchestra.run.smithi071.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.8 MB/s | 35 MB 00:09 2024-09-21T06:50:55.401 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:50:55.401 INFO:teuthology.orchestra.run.smithi071.stdout:Total 8.6 MB/s | 79 MB 00:09 2024-09-21T06:50:55.723 INFO:teuthology.orchestra.run.smithi063.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:04 2024-09-21T06:50:56.090 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-21T06:50:56.441 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-21T06:50:56.441 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-21T06:50:57.415 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-21T06:50:57.415 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-21T06:50:59.862 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-21T06:51:00.315 INFO:teuthology.orchestra.run.smithi063.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 4.0 MB/s | 35 MB 00:08 2024-09-21T06:51:00.315 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:51:00.315 INFO:teuthology.orchestra.run.smithi063.stdout:Total 9.1 MB/s | 79 MB 00:08 2024-09-21T06:51:00.505 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:51:00.594 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:51:01.033 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-21T06:51:01.419 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-21T06:51:01.419 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-21T06:51:02.385 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-21T06:51:02.385 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-21T06:51:03.382 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:51:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:51:04.936 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-21T06:51:05.594 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:51:05.675 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:51:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:51:08.415 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:51:08.432 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:51:08.545 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:51:13.277 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:51:13.664 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:51:13.704 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:51:18.855 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:51:51.683 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:51:51.723 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:51:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:51:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:51:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:51:52.099 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:51:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:51:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:51:52.967 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-21T06:51:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T06:51:52.967 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T06:51:52.968 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T06:51:52.968 INFO:teuthology.orchestra.run.smithi071.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T06:51:52.968 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:51:52.968 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-21T06:51:53.335 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:51:53.420 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:51:53.420 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:51:53.421 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T06:51:53.421 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T06:51:53.421 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T06:51:53.421 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-21T06:51:53.421 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T06:51:53.421 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:51:53.478 INFO:teuthology.orchestra.run.smithi071.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:51:53.479 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:51:53.479 DEBUG:teuthology.orchestra.run.smithi071:> sudo rpm -qi grub2-tools 2024-09-21T06:51:53.511 INFO:teuthology.orchestra.run.smithi071.stdout:Name : grub2-tools 2024-09-21T06:51:53.511 INFO:teuthology.orchestra.run.smithi071.stdout:Epoch : 1 2024-09-21T06:51:53.511 INFO:teuthology.orchestra.run.smithi071.stdout:Version : 2.06 2024-09-21T06:51:53.511 INFO:teuthology.orchestra.run.smithi071.stdout:Release : 82.el9 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: x86_64 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:Group : Unspecified 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:Size : 8274670 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:License : GPLv3+ 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:Packager : builder@centos.org 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:Vendor : CentOS 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:Summary : Support tools for GRUB. 2024-09-21T06:51:53.512 INFO:teuthology.orchestra.run.smithi071.stdout:Description : 2024-09-21T06:51:53.513 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:51:53.513 INFO:teuthology.orchestra.run.smithi071.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T06:51:53.513 INFO:teuthology.orchestra.run.smithi071.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T06:51:53.513 INFO:teuthology.orchestra.run.smithi071.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T06:51:53.513 INFO:teuthology.orchestra.run.smithi071.stdout:hardware devices. 2024-09-21T06:51:53.513 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:51:53.513 INFO:teuthology.orchestra.run.smithi071.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T06:51:53.514 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T06:51:53.514 INFO:teuthology.task.kernel:Updating grub on smithi071 to boot 5.14.0-508.el9.x86_64 2024-09-21T06:51:53.514 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T06:51:54.178 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2024-09-21T06:51:55.488 INFO:teuthology.orchestra.run.smithi071.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T06:51:55.518 INFO:teuthology.orchestra.run.smithi071.stderr:done 2024-09-21T06:51:55.522 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-21T06:51:55.538 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.M5IIiQgiGS 2024-09-21T06:51:55.539 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.M5IIiQgiGS 2024-09-21T06:51:55.607 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.M5IIiQgiGS 2024-09-21T06:51:55.744 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.M5IIiQgiGS is 6KB 2024-09-21T06:51:55.792 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.M5IIiQgiGS 2024-09-21T06:51:55.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T06:51:55.870 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T06:51:55.870 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T06:51:55.870 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T06:51:55.870 INFO:teuthology.orchestra.run.smithi071.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T06:51:55.871 DEBUG:teuthology.orchestra.run.smithi071:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T06:51:56.046 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2024-09-21T06:51:57.702 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:51:57.743 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:51:58.061 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:51:58.061 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:51:58.061 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:51:58.061 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:51:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:51:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:51:58.927 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-21T06:51:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T06:51:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T06:51:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T06:51:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T06:51:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:51:58.928 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-21T06:51:59.266 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:51:59.344 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:51:59.345 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:51:59.345 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T06:51:59.345 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T06:51:59.345 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T06:51:59.345 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T06:51:59.345 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T06:51:59.345 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:51:59.404 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:51:59.404 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:51:59.404 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -qi grub2-tools 2024-09-21T06:51:59.441 INFO:teuthology.orchestra.run.smithi063.stdout:Name : grub2-tools 2024-09-21T06:51:59.441 INFO:teuthology.orchestra.run.smithi063.stdout:Epoch : 1 2024-09-21T06:51:59.441 INFO:teuthology.orchestra.run.smithi063.stdout:Version : 2.06 2024-09-21T06:51:59.441 INFO:teuthology.orchestra.run.smithi063.stdout:Release : 82.el9 2024-09-21T06:51:59.441 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: x86_64 2024-09-21T06:51:59.441 INFO:teuthology.orchestra.run.smithi063.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T06:51:59.441 INFO:teuthology.orchestra.run.smithi063.stdout:Group : Unspecified 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout:Size : 8274670 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout:License : GPLv3+ 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout:Packager : builder@centos.org 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout:Vendor : CentOS 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout:Summary : Support tools for GRUB. 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout:Description : 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T06:51:59.442 INFO:teuthology.orchestra.run.smithi063.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T06:51:59.443 INFO:teuthology.orchestra.run.smithi063.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T06:51:59.443 INFO:teuthology.orchestra.run.smithi063.stdout:hardware devices. 2024-09-21T06:51:59.443 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:51:59.443 INFO:teuthology.orchestra.run.smithi063.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T06:51:59.443 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T06:51:59.444 INFO:teuthology.task.kernel:Updating grub on smithi063 to boot 5.14.0-508.el9.x86_64 2024-09-21T06:51:59.444 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T06:52:00.185 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-09-21T06:52:01.583 INFO:teuthology.orchestra.run.smithi063.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T06:52:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-09-21T06:52:01.619 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-21T06:52:01.633 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.zieHycTlOz 2024-09-21T06:52:01.633 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zieHycTlOz 2024-09-21T06:52:01.699 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.zieHycTlOz 2024-09-21T06:52:01.833 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.zieHycTlOz is 6KB 2024-09-21T06:52:01.881 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.zieHycTlOz 2024-09-21T06:52:01.896 DEBUG:teuthology.orchestra.run.smithi063:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T06:52:01.958 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T06:52:01.958 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T06:52:01.958 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T06:52:01.958 INFO:teuthology.orchestra.run.smithi063.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T06:52:01.959 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T06:52:02.115 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2024-09-21T06:52:26.070 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-21T06:52:26.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-21T06:52:26.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:52:32.122 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T06:52:32.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-21T06:52:32.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:53:06.675 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-21T06:53:15.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-21T06:53:15.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:53:26.079 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T06:53:34.067 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-09-21T06:53:35.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-21T06:53:35.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:53:35.466 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-21T06:53:35.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-21T06:53:35.774 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-508.el9.x86_64"... 2024-09-21T06:53:35.774 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-09-21T06:53:35.788 INFO:teuthology.orchestra.run.smithi071.stdout:5.14.0-508.el9.x86_64 2024-09-21T06:53:35.788 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T06:53:35.788 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T06:53:35.788 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T06:53:36.789 DEBUG:teuthology.parallel:result is None 2024-09-21T06:53:46.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-21T06:53:46.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:53:46.442 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-21T06:53:46.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-21T06:53:46.878 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T06:53:46.878 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-09-21T06:53:46.893 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-508.el9.x86_64 2024-09-21T06:53:46.893 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T06:53:46.894 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T06:53:46.894 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T06:53:47.894 DEBUG:teuthology.parallel:result is None 2024-09-21T06:53:47.894 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T06:53:47.902 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T06:53:47.902 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:53:47.905 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:53:47.925 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T06:53:47.931 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T06:53:47.937 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T06:53:47.938 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:53:47.962 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:53:48.015 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T06:53:48.021 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T06:53:48.021 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:53:48.026 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:53:48.108 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:53:48.128 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:53:48.147 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:53:48.189 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:53:48.191 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T06:53:48.198 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T06:53:48.198 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:53:48.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:53:48.228 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T06:53:48.237 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T06:53:48.237 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:53:48.268 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:53:48.285 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:53:48.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:53:48.414 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:53:48.497 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:53:48.540 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:53:48.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:53:48.626 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:53:48.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:53:48.726 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:53:48.811 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:53:48.854 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:53:48.854 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:53:48.921 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-09-21T06:53:48.923 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-09-21T06:53:48.969 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:53:49.021 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:53:49.526 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T06:53:49.556 INFO:teuthology.task.internal:Starting timer... 2024-09-21T06:53:49.556 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T06:53:49.602 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T06:53:49.653 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2024-09-21T06:53:49.697 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2024-09-21T06:53:49.700 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-09-21T06:53:49.753 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-09-21T06:53:49.756 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T06:53:49.756 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2024-09-21T06:53:49.778 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2024-09-21T06:53:49.778 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-09-21T06:53:49.800 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-09-21T06:53:49.800 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi063.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi071.front.sepia.ceph.com': 'permissive'} 2024-09-21T06:53:49.800 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T06:53:49.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:53:49.846 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T06:53:49.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:53:49.874 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T06:53:49.874 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:53:49.938 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:53:49.970 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T06:53:49.980 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T06:53:49.983 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T06:53:50.108 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T06:53:50.118 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T06:53:50.119 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi071.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T06:57:36.620 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi071.front.sepia.ceph.com')] 2024-09-21T06:57:36.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-21T06:57:36.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:57:36.705 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-09-21T06:57:36.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-09-21T06:57:36.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-21T06:57:36.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:57:36.856 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-21T06:57:36.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-21T06:57:36.895 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T06:57:36.904 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T06:57:36.905 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:57:36.905 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:57:36.907 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:57:36.907 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:57:36.935 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:57:36.950 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:57:36.965 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:57:36.976 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2024-09-21T06:57:36.979 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:57:36.988 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2024-09-21T06:57:37.003 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:57:37.003 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-09-21T06:57:37.014 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-09-21T06:57:37.017 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:57:37.028 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:57:37.042 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:57:37.080 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:57:37.083 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:57:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-21T06:57:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:57:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:57:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:57:37.084 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:57:37.107 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:57:37.111 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:57:37.111 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-21T06:57:37.111 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:57:37.111 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:57:37.111 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:57:37.111 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:57:37.111 INFO:teuthology.run_tasks:Running task install... 2024-09-21T06:57:37.119 DEBUG:teuthology.task.install:project ceph 2024-09-21T06:57:37.120 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T06:57:37.120 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T06:57:37.120 INFO:teuthology.task.install:Using flavor: default 2024-09-21T06:57:37.125 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T06:57:37.125 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T06:57:37.125 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:57:37.126 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:57:37.127 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:57:37.128 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:57:37.275 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:57:37.276 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:57:37.280 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:57:37.280 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:57:37.388 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:57:37.388 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:57:37.388 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:57:37.397 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:57:37.397 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:57:37.397 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:57:37.415 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:57:37.415 DEBUG:teuthology.orchestra.run.smithi063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:57:37.422 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:57:37.423 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:57:37.482 DEBUG:teuthology.orchestra.run.smithi063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:57:37.487 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:57:37.557 DEBUG:teuthology.orchestra.run.smithi063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:57:37.561 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:57:37.622 INFO:teuthology.orchestra.run.smithi063.stdout:check_obsoletes = 1 2024-09-21T06:57:37.624 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum clean all 2024-09-21T06:57:37.626 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-09-21T06:57:37.627 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-09-21T06:57:37.851 INFO:teuthology.orchestra.run.smithi071.stdout:45 files removed 2024-09-21T06:57:37.866 INFO:teuthology.orchestra.run.smithi063.stdout:45 files removed 2024-09-21T06:57:37.877 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:57:37.894 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:57:38.425 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-09-21T06:57:38.462 INFO:teuthology.orchestra.run.smithi063.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-21T06:57:38.734 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-09-21T06:57:38.754 INFO:teuthology.orchestra.run.smithi063.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T06:57:39.001 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-21T06:57:39.038 INFO:teuthology.orchestra.run.smithi063.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-21T06:57:39.530 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.3 MB 00:00 2024-09-21T06:57:40.793 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-21T06:57:41.298 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-21T06:57:44.336 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 20 MB 00:02 2024-09-21T06:57:45.674 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-21T06:57:47.124 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 116 kB/s | 19 kB 00:00 2024-09-21T06:57:48.237 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T06:57:50.378 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-21T06:57:51.928 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-21T06:57:53.024 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T06:57:54.218 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 4.7 kB/s | 1.7 kB 00:00 2024-09-21T06:57:56.523 INFO:teuthology.orchestra.run.smithi063.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:57:56.524 INFO:teuthology.orchestra.run.smithi063.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:57:56.538 INFO:teuthology.orchestra.run.smithi063.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:57:56.539 INFO:teuthology.orchestra.run.smithi063.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:57:56.540 INFO:teuthology.orchestra.run.smithi063.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:57:56.541 INFO:teuthology.orchestra.run.smithi063.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:57:56.544 INFO:teuthology.orchestra.run.smithi063.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:57:56.546 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:57:56.547 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:57:56.616 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-09-21T06:57:56.641 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-21T06:57:56.642 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-09-21T06:57:56.642 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-21T06:57:56.642 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-09-21T06:57:56.642 INFO:teuthology.orchestra.run.smithi063.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:57:56.642 INFO:teuthology.orchestra.run.smithi063.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:57:56.642 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:57:56.642 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:57:56.642 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:57:56.642 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:57:56.642 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:57:56.642 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:57:56.642 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:57:56.642 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:57:56.643 INFO:teuthology.orchestra.run.smithi063.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:57:56.644 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:57:56.645 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:57:56.646 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:57:56.647 INFO:teuthology.orchestra.run.smithi063.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:57:56.648 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:57:56.649 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:57:56.650 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:57:56.650 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:57:56.650 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:57:56.650 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:57:56.650 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:57:56.650 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:57:56.650 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:57:56.650 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:57:56.650 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:57:56.650 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:57:56.650 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:57:56.650 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:57:56.650 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:57:56.651 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:57:56.652 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:57:56.653 INFO:teuthology.orchestra.run.smithi063.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:57:56.653 INFO:teuthology.orchestra.run.smithi063.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:57:56.653 INFO:teuthology.orchestra.run.smithi063.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:57:56.653 INFO:teuthology.orchestra.run.smithi063.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:57:56.653 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:57:56.653 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:57:56.653 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2024-09-21T06:57:56.653 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:57:56.653 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:57:56.653 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-09-21T06:57:56.653 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================= 2024-09-21T06:57:56.653 INFO:teuthology.orchestra.run.smithi063.stdout:Install 149 Packages 2024-09-21T06:57:56.654 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 8 Packages 2024-09-21T06:57:56.654 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:57:56.655 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 228 M 2024-09-21T06:57:56.655 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-09-21T06:57:57.394 INFO:teuthology.orchestra.run.smithi063.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 50 kB/s | 6.6 kB 00:00 2024-09-21T06:57:57.586 INFO:teuthology.orchestra.run.smithi063.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.5 MB/s | 873 kB 00:00 2024-09-21T06:57:57.669 INFO:teuthology.orchestra.run.smithi063.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.7 MB/s | 148 kB 00:00 2024-09-21T06:57:57.761 INFO:teuthology.orchestra.run.smithi063.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T06:57:57.862 INFO:teuthology.orchestra.run.smithi063.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 15 MB/s | 1.5 MB 00:00 2024-09-21T06:57:57.920 INFO:teuthology.orchestra.run.smithi063.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 9.1 MB/s | 2.3 MB 00:00 2024-09-21T06:57:58.171 INFO:teuthology.orchestra.run.smithi063.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 16 MB/s | 5.0 MB 00:00 2024-09-21T06:57:58.371 INFO:teuthology.orchestra.run.smithi063.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T06:57:58.413 INFO:teuthology.orchestra.run.smithi063.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 605 kB/s | 25 kB 00:00 2024-09-21T06:57:58.429 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-21T06:57:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 18 MB/s | 18 MB 00:01 2024-09-21T06:57:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T06:57:59.096 INFO:teuthology.orchestra.run.smithi063.stdout:(12/157): ceph-radosgw-19.3.0-5120.g18432218.el 11 MB/s | 10 MB 00:00 2024-09-21T06:57:59.122 INFO:teuthology.orchestra.run.smithi063.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 202 kB/s | 27 kB 00:00 2024-09-21T06:57:59.156 INFO:teuthology.orchestra.run.smithi063.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 540 kB/s | 32 kB 00:00 2024-09-21T06:57:59.198 INFO:teuthology.orchestra.run.smithi063.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 9.9 MB/s | 766 kB 00:00 2024-09-21T06:57:59.223 INFO:teuthology.orchestra.run.smithi063.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T06:57:59.248 INFO:teuthology.orchestra.run.smithi063.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T06:57:59.273 INFO:teuthology.orchestra.run.smithi063.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 9.9 MB/s | 507 kB 00:00 2024-09-21T06:57:59.324 INFO:teuthology.orchestra.run.smithi063.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 901 kB/s | 45 kB 00:00 2024-09-21T06:57:59.432 INFO:teuthology.orchestra.run.smithi063.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.3 MB/s | 148 kB 00:00 2024-09-21T06:57:59.516 INFO:teuthology.orchestra.run.smithi063.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 20 MB/s | 5.3 MB 00:00 2024-09-21T06:57:59.541 INFO:teuthology.orchestra.run.smithi063.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.5 MB/s | 161 kB 00:00 2024-09-21T06:57:59.566 INFO:teuthology.orchestra.run.smithi063.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 6.3 MB/s | 321 kB 00:00 2024-09-21T06:57:59.592 INFO:teuthology.orchestra.run.smithi063.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T06:57:59.609 INFO:teuthology.orchestra.run.smithi063.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 2.3 MB/s | 99 kB 00:00 2024-09-21T06:57:59.634 INFO:teuthology.orchestra.run.smithi063.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 2.0 MB/s | 86 kB 00:00 2024-09-21T06:57:59.709 INFO:teuthology.orchestra.run.smithi063.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-21T06:57:59.768 INFO:teuthology.orchestra.run.smithi063.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 20 MB/s | 3.1 MB 00:00 2024-09-21T06:57:59.793 INFO:teuthology.orchestra.run.smithi063.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 410 kB/s | 34 kB 00:00 2024-09-21T06:57:59.818 INFO:teuthology.orchestra.run.smithi063.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T06:58:00.160 INFO:teuthology.orchestra.run.smithi063.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 22 MB/s | 7.4 MB 00:00 2024-09-21T06:58:00.519 INFO:teuthology.orchestra.run.smithi063.stdout:(32/157): ceph-test-19.3.0-5120.g18432218.el9.x 19 MB/s | 40 MB 00:02 2024-09-21T06:58:00.544 INFO:teuthology.orchestra.run.smithi063.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 761 kB/s | 292 kB 00:00 2024-09-21T06:58:00.570 INFO:teuthology.orchestra.run.smithi063.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 990 kB/s | 49 kB 00:00 2024-09-21T06:58:00.594 INFO:teuthology.orchestra.run.smithi063.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T06:58:00.620 INFO:teuthology.orchestra.run.smithi063.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T06:58:00.641 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:58:00.642 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:58:00.655 INFO:teuthology.orchestra.run.smithi071.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:58:00.656 INFO:teuthology.orchestra.run.smithi071.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:58:00.657 INFO:teuthology.orchestra.run.smithi071.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:58:00.658 INFO:teuthology.orchestra.run.smithi071.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:58:00.660 INFO:teuthology.orchestra.run.smithi071.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:58:00.662 INFO:teuthology.orchestra.run.smithi063.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 11 MB/s | 784 kB 00:00 2024-09-21T06:58:00.663 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:58:00.664 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:58:00.687 INFO:teuthology.orchestra.run.smithi063.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 275 kB/s | 18 kB 00:00 2024-09-21T06:58:00.726 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-21T06:58:00.744 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-21T06:58:00.744 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-21T06:58:00.744 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-21T06:58:00.744 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-21T06:58:00.744 INFO:teuthology.orchestra.run.smithi071.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:58:00.744 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:58:00.744 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:58:00.744 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:58:00.744 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:58:00.745 INFO:teuthology.orchestra.run.smithi071.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:58:00.746 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:58:00.746 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:58:00.746 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:58:00.746 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:58:00.746 INFO:teuthology.orchestra.run.smithi071.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:58:00.746 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:58:00.746 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:58:00.746 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:58:00.746 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:58:00.746 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:58:00.746 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:58:00.746 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:58:00.746 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:58:00.747 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-21T06:58:00.748 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:58:00.748 INFO:teuthology.orchestra.run.smithi071.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:58:00.748 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:58:00.748 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:58:00.748 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:58:00.748 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:58:00.748 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:58:00.748 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:58:00.748 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:58:00.748 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:58:00.748 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:58:00.748 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:58:00.748 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:58:00.749 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:58:00.750 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:58:00.751 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:58:00.752 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:58:00.752 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:58:00.752 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:58:00.752 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:58:00.752 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:58:00.752 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:58:00.752 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:58:00.752 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:58:00.752 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:58:00.752 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:58:00.752 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:58:00.752 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:58:00.752 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:58:00.753 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:58:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:58:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:58:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:58:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:58:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:58:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:58:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:58:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:58:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:58:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:58:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:58:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:58:00.754 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:58:00.755 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:58:00.756 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:58:00.756 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-09-21T06:58:00.756 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:58:00.756 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:58:00.756 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-21T06:58:00.756 INFO:teuthology.orchestra.run.smithi071.stdout:======================================================================================= 2024-09-21T06:58:00.756 INFO:teuthology.orchestra.run.smithi071.stdout:Install 149 Packages 2024-09-21T06:58:00.756 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 8 Packages 2024-09-21T06:58:00.756 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:58:00.757 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 228 M 2024-09-21T06:58:00.757 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-21T06:58:00.937 INFO:teuthology.orchestra.run.smithi063.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T06:58:00.962 INFO:teuthology.orchestra.run.smithi063.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 266 kB/s | 80 kB 00:00 2024-09-21T06:58:01.054 INFO:teuthology.orchestra.run.smithi063.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.1 MB/s | 801 kB 00:00 2024-09-21T06:58:01.079 INFO:teuthology.orchestra.run.smithi063.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-21T06:58:01.130 INFO:teuthology.orchestra.run.smithi063.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T06:58:01.163 INFO:teuthology.orchestra.run.smithi063.stdout:(44/157): libquadmath-11.5.0-2.el9.x86_64.rpm 847 kB/s | 191 kB 00:00 2024-09-21T06:58:01.197 INFO:teuthology.orchestra.run.smithi063.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-21T06:58:01.223 INFO:teuthology.orchestra.run.smithi063.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-21T06:58:01.264 INFO:teuthology.orchestra.run.smithi071.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-21T06:58:01.266 INFO:teuthology.orchestra.run.smithi063.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-21T06:58:01.398 INFO:teuthology.orchestra.run.smithi063.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-21T06:58:01.440 INFO:teuthology.orchestra.run.smithi063.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 5.3 MB/s | 943 kB 00:00 2024-09-21T06:58:01.474 INFO:teuthology.orchestra.run.smithi063.stdout:(50/157): python3-cryptography-36.0.1-4.el9.x86 2.9 MB/s | 1.2 MB 00:00 2024-09-21T06:58:01.499 INFO:teuthology.orchestra.run.smithi063.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-21T06:58:01.524 INFO:teuthology.orchestra.run.smithi063.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 258 kB/s | 22 kB 00:00 2024-09-21T06:58:01.566 INFO:teuthology.orchestra.run.smithi063.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-21T06:58:01.589 INFO:teuthology.orchestra.run.smithi071.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.6 MB/s | 873 kB 00:00 2024-09-21T06:58:01.633 INFO:teuthology.orchestra.run.smithi063.stdout:(54/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-09-21T06:58:01.656 INFO:teuthology.orchestra.run.smithi071.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-21T06:58:01.658 INFO:teuthology.orchestra.run.smithi063.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-09-21T06:58:01.681 INFO:teuthology.orchestra.run.smithi071.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.6 MB/s | 148 kB 00:00 2024-09-21T06:58:01.683 INFO:teuthology.orchestra.run.smithi063.stdout:(56/157): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 313 kB 00:00 2024-09-21T06:58:01.709 INFO:teuthology.orchestra.run.smithi063.stdout:(57/157): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-21T06:58:01.751 INFO:teuthology.orchestra.run.smithi063.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.8 MB/s | 171 kB 00:00 2024-09-21T06:58:01.776 INFO:teuthology.orchestra.run.smithi063.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-21T06:58:01.790 INFO:teuthology.orchestra.run.smithi071.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 17 MB/s | 2.3 MB 00:00 2024-09-21T06:58:01.801 INFO:teuthology.orchestra.run.smithi063.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 492 kB/s | 45 kB 00:00 2024-09-21T06:58:01.843 INFO:teuthology.orchestra.run.smithi063.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-21T06:58:01.868 INFO:teuthology.orchestra.run.smithi063.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-21T06:58:01.918 INFO:teuthology.orchestra.run.smithi063.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-21T06:58:01.944 INFO:teuthology.orchestra.run.smithi063.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-09-21T06:58:01.969 INFO:teuthology.orchestra.run.smithi063.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-21T06:58:01.994 INFO:teuthology.orchestra.run.smithi063.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-21T06:58:02.019 INFO:teuthology.orchestra.run.smithi063.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-21T06:58:02.048 INFO:teuthology.orchestra.run.smithi071.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 19 MB/s | 5.0 MB 00:00 2024-09-21T06:58:02.128 INFO:teuthology.orchestra.run.smithi063.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-09-21T06:58:02.178 INFO:teuthology.orchestra.run.smithi063.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-21T06:58:02.232 INFO:teuthology.orchestra.run.smithi071.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T06:58:02.245 INFO:teuthology.orchestra.run.smithi063.stdout:(70/157): openblas-openmp-0.3.26-2.el9.x86_64.r 18 MB/s | 4.9 MB 00:00 2024-09-21T06:58:02.271 INFO:teuthology.orchestra.run.smithi063.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-21T06:58:02.274 INFO:teuthology.orchestra.run.smithi071.stdout:(8/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 2.6 MB/s | 1.5 MB 00:00 2024-09-21T06:58:02.304 INFO:teuthology.orchestra.run.smithi063.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-21T06:58:02.355 INFO:teuthology.orchestra.run.smithi063.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-21T06:58:02.366 INFO:teuthology.orchestra.run.smithi071.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 275 kB/s | 25 kB 00:00 2024-09-21T06:58:02.371 INFO:teuthology.orchestra.run.smithi063.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T06:58:02.455 INFO:teuthology.orchestra.run.smithi063.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 28 MB/s | 5.8 MB 00:00 2024-09-21T06:58:02.471 INFO:teuthology.orchestra.run.smithi063.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 612 kB/s | 61 kB 00:00 2024-09-21T06:58:02.564 INFO:teuthology.orchestra.run.smithi063.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-09-21T06:58:02.597 INFO:teuthology.orchestra.run.smithi063.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-21T06:58:02.623 INFO:teuthology.orchestra.run.smithi063.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-21T06:58:02.640 INFO:teuthology.orchestra.run.smithi063.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 340 kB/s | 26 kB 00:00 2024-09-21T06:58:02.665 INFO:teuthology.orchestra.run.smithi063.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 459 kB/s | 19 kB 00:00 2024-09-21T06:58:02.707 INFO:teuthology.orchestra.run.smithi063.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T06:58:02.724 INFO:teuthology.orchestra.run.smithi063.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 414 kB/s | 35 kB 00:00 2024-09-21T06:58:02.807 INFO:teuthology.orchestra.run.smithi063.stdout:(84/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-21T06:58:02.832 INFO:teuthology.orchestra.run.smithi063.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-09-21T06:58:02.858 INFO:teuthology.orchestra.run.smithi063.stdout:(86/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-09-21T06:58:02.875 INFO:teuthology.orchestra.run.smithi063.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-21T06:58:02.900 INFO:teuthology.orchestra.run.smithi071.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 16 MB/s | 10 MB 00:00 2024-09-21T06:58:02.900 INFO:teuthology.orchestra.run.smithi063.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 630 kB/s | 42 kB 00:00 2024-09-21T06:58:02.934 INFO:teuthology.orchestra.run.smithi063.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-21T06:58:02.966 INFO:teuthology.orchestra.run.smithi071.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.3 MB/s | 226 kB 00:00 2024-09-21T06:58:02.967 INFO:teuthology.orchestra.run.smithi063.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-09-21T06:58:02.992 INFO:teuthology.orchestra.run.smithi063.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 874 kB/s | 51 kB 00:00 2024-09-21T06:58:03.018 INFO:teuthology.orchestra.run.smithi063.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-21T06:58:03.043 INFO:teuthology.orchestra.run.smithi063.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 714 kB/s | 54 kB 00:00 2024-09-21T06:58:03.085 INFO:teuthology.orchestra.run.smithi063.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 625 kB/s | 42 kB 00:00 2024-09-21T06:58:03.110 INFO:teuthology.orchestra.run.smithi063.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 660 kB/s | 44 kB 00:00 2024-09-21T06:58:03.152 INFO:teuthology.orchestra.run.smithi063.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-21T06:58:03.169 INFO:teuthology.orchestra.run.smithi071.stdout:(12/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 16 MB/s | 18 MB 00:01 2024-09-21T06:58:03.177 INFO:teuthology.orchestra.run.smithi063.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 536 kB/s | 36 kB 00:00 2024-09-21T06:58:03.194 INFO:teuthology.orchestra.run.smithi071.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 119 kB/s | 27 kB 00:00 2024-09-21T06:58:03.202 INFO:teuthology.orchestra.run.smithi063.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-21T06:58:03.219 INFO:teuthology.orchestra.run.smithi071.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 637 kB/s | 32 kB 00:00 2024-09-21T06:58:03.253 INFO:teuthology.orchestra.run.smithi063.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-09-21T06:58:03.261 INFO:teuthology.orchestra.run.smithi071.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 11 MB/s | 766 kB 00:00 2024-09-21T06:58:03.278 INFO:teuthology.orchestra.run.smithi063.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 768 kB/s | 58 kB 00:00 2024-09-21T06:58:03.286 INFO:teuthology.orchestra.run.smithi071.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T06:58:03.312 INFO:teuthology.orchestra.run.smithi071.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T06:58:03.337 INFO:teuthology.orchestra.run.smithi071.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 9.9 MB/s | 507 kB 00:00 2024-09-21T06:58:03.404 INFO:teuthology.orchestra.run.smithi071.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 678 kB/s | 45 kB 00:00 2024-09-21T06:58:03.445 INFO:teuthology.orchestra.run.smithi063.stdout:(101/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-09-21T06:58:03.463 INFO:teuthology.orchestra.run.smithi071.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.5 MB/s | 148 kB 00:00 2024-09-21T06:58:03.470 INFO:teuthology.orchestra.run.smithi063.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 332 kB/s | 64 kB 00:00 2024-09-21T06:58:03.495 INFO:teuthology.orchestra.run.smithi063.stdout:(103/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 395 kB/s | 96 kB 00:00 2024-09-21T06:58:03.521 INFO:teuthology.orchestra.run.smithi063.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 597 kB/s | 45 kB 00:00 2024-09-21T06:58:03.521 INFO:teuthology.orchestra.run.smithi071.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T06:58:03.579 INFO:teuthology.orchestra.run.smithi063.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T06:58:03.596 INFO:teuthology.orchestra.run.smithi071.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 19 MB/s | 5.3 MB 00:00 2024-09-21T06:58:03.613 INFO:teuthology.orchestra.run.smithi063.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T06:58:03.622 INFO:teuthology.orchestra.run.smithi071.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 3.1 MB/s | 321 kB 00:00 2024-09-21T06:58:03.638 INFO:teuthology.orchestra.run.smithi063.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-21T06:58:03.655 INFO:teuthology.orchestra.run.smithi071.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T06:58:03.681 INFO:teuthology.orchestra.run.smithi071.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T06:58:03.714 INFO:teuthology.orchestra.run.smithi071.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T06:58:03.763 INFO:teuthology.orchestra.run.smithi063.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-21T06:58:03.805 INFO:teuthology.orchestra.run.smithi063.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T06:58:03.815 INFO:teuthology.orchestra.run.smithi071.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.7 MB/s | 170 kB 00:00 2024-09-21T06:58:03.831 INFO:teuthology.orchestra.run.smithi063.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T06:58:03.856 INFO:teuthology.orchestra.run.smithi063.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T06:58:03.881 INFO:teuthology.orchestra.run.smithi063.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.3 MB/s | 151 kB 00:00 2024-09-21T06:58:03.907 INFO:teuthology.orchestra.run.smithi071.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 14 MB/s | 3.1 MB 00:00 2024-09-21T06:58:03.915 INFO:teuthology.orchestra.run.smithi063.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-21T06:58:03.932 INFO:teuthology.orchestra.run.smithi071.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 293 kB/s | 34 kB 00:00 2024-09-21T06:58:03.948 INFO:teuthology.orchestra.run.smithi063.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T06:58:03.965 INFO:teuthology.orchestra.run.smithi063.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-21T06:58:03.966 INFO:teuthology.orchestra.run.smithi071.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.6 MB/s | 154 kB 00:00 2024-09-21T06:58:03.982 INFO:teuthology.orchestra.run.smithi063.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-21T06:58:03.999 INFO:teuthology.orchestra.run.smithi063.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 843 kB/s | 14 kB 00:00 2024-09-21T06:58:04.024 INFO:teuthology.orchestra.run.smithi063.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T06:58:04.066 INFO:teuthology.orchestra.run.smithi063.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-09-21T06:58:04.092 INFO:teuthology.orchestra.run.smithi063.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2024-09-21T06:58:04.108 INFO:teuthology.orchestra.run.smithi063.stdout:(121/157): lua-devel-5.4.4-4.el9.x86_64.rpm 35 kB/s | 22 kB 00:00 2024-09-21T06:58:04.142 INFO:teuthology.orchestra.run.smithi063.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T06:58:04.167 INFO:teuthology.orchestra.run.smithi063.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 6.1 MB/s | 144 kB 00:00 2024-09-21T06:58:04.184 INFO:teuthology.orchestra.run.smithi063.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 645 kB/s | 11 kB 00:00 2024-09-21T06:58:04.201 INFO:teuthology.orchestra.run.smithi063.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-21T06:58:04.227 INFO:teuthology.orchestra.run.smithi063.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-21T06:58:04.252 INFO:teuthology.orchestra.run.smithi063.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-21T06:58:04.277 INFO:teuthology.orchestra.run.smithi063.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 793 kB/s | 20 kB 00:00 2024-09-21T06:58:04.335 INFO:teuthology.orchestra.run.smithi063.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-21T06:58:04.361 INFO:teuthology.orchestra.run.smithi063.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:58:04.386 INFO:teuthology.orchestra.run.smithi063.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:58:04.412 INFO:teuthology.orchestra.run.smithi063.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:58:04.462 INFO:teuthology.orchestra.run.smithi063.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-09-21T06:58:04.487 INFO:teuthology.orchestra.run.smithi063.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-21T06:58:04.491 INFO:teuthology.orchestra.run.smithi071.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 14 MB/s | 7.4 MB 00:00 2024-09-21T06:58:04.521 INFO:teuthology.orchestra.run.smithi063.stdout:(135/157): protobuf-compiler-3.14.0-13.el9.x86_ 842 kB/s | 863 kB 00:01 2024-09-21T06:58:04.554 INFO:teuthology.orchestra.run.smithi063.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-21T06:58:04.566 INFO:teuthology.orchestra.run.smithi071.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.8 MB/s | 292 kB 00:00 2024-09-21T06:58:04.579 INFO:teuthology.orchestra.run.smithi063.stdout:(137/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-21T06:58:04.605 INFO:teuthology.orchestra.run.smithi063.stdout:(138/157): python3-pyperclip-1.8.2-2.el9.noarch 338 kB/s | 28 kB 00:00 2024-09-21T06:58:04.616 INFO:teuthology.orchestra.run.smithi071.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 993 kB/s | 49 kB 00:00 2024-09-21T06:58:04.630 INFO:teuthology.orchestra.run.smithi063.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 419 kB/s | 31 kB 00:00 2024-09-21T06:58:04.655 INFO:teuthology.orchestra.run.smithi063.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T06:58:04.675 INFO:teuthology.orchestra.run.smithi071.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 281 kB/s | 16 kB 00:00 2024-09-21T06:58:04.689 INFO:teuthology.orchestra.run.smithi063.stdout:(141/157): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-21T06:58:04.714 INFO:teuthology.orchestra.run.smithi063.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-21T06:58:04.740 INFO:teuthology.orchestra.run.smithi063.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 885 kB/s | 74 kB 00:00 2024-09-21T06:58:04.825 INFO:teuthology.orchestra.run.smithi071.stdout:(35/157): ceph-mgr-dashboard-19.3.0-5120.g18432 16 MB/s | 14 MB 00:00 2024-09-21T06:58:04.850 INFO:teuthology.orchestra.run.smithi071.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 1.6 MB/s | 285 kB 00:00 2024-09-21T06:58:04.892 INFO:teuthology.orchestra.run.smithi071.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 12 MB/s | 784 kB 00:00 2024-09-21T06:58:04.903 INFO:teuthology.orchestra.run.smithi063.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 557 kB/s | 90 kB 00:00 2024-09-21T06:58:04.917 INFO:teuthology.orchestra.run.smithi071.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 275 kB/s | 18 kB 00:00 2024-09-21T06:58:04.978 INFO:teuthology.orchestra.run.smithi063.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 799 kB/s | 230 kB 00:00 2024-09-21T06:58:05.007 INFO:teuthology.orchestra.run.smithi063.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 192 kB/s | 20 kB 00:00 2024-09-21T06:58:05.026 INFO:teuthology.orchestra.run.smithi071.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-21T06:58:05.039 INFO:teuthology.orchestra.run.smithi063.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.1 MB/s | 191 kB 00:00 2024-09-21T06:58:05.072 INFO:teuthology.orchestra.run.smithi063.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 1.3 MB/s | 427 kB 00:00 2024-09-21T06:58:05.131 INFO:teuthology.orchestra.run.smithi063.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T06:58:05.135 INFO:teuthology.orchestra.run.smithi071.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-21T06:58:05.244 INFO:teuthology.orchestra.run.smithi071.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-21T06:58:05.269 INFO:teuthology.orchestra.run.smithi071.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 801 kB 00:00 2024-09-21T06:58:05.353 INFO:teuthology.orchestra.run.smithi071.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-21T06:58:05.407 INFO:teuthology.orchestra.run.smithi063.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.5 MB/s | 3.2 MB 00:00 2024-09-21T06:58:05.457 INFO:teuthology.orchestra.run.smithi063.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 8.1 MB/s | 3.4 MB 00:00 2024-09-21T06:58:05.544 INFO:teuthology.orchestra.run.smithi071.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 706 kB/s | 135 kB 00:00 2024-09-21T06:58:05.574 INFO:teuthology.orchestra.run.smithi063.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 350 kB/s | 41 kB 00:00 2024-09-21T06:58:05.578 INFO:teuthology.orchestra.run.smithi071.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 3.7 MB/s | 1.2 MB 00:00 2024-09-21T06:58:05.620 INFO:teuthology.orchestra.run.smithi071.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-21T06:58:05.670 INFO:teuthology.orchestra.run.smithi071.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T06:58:05.691 INFO:teuthology.orchestra.run.smithi063.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-21T06:58:05.771 INFO:teuthology.orchestra.run.smithi071.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 4.5 MB/s | 689 kB 00:00 2024-09-21T06:58:05.791 INFO:teuthology.orchestra.run.smithi063.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.7 MB/s | 1.8 MB 00:00 2024-09-21T06:58:05.812 INFO:teuthology.orchestra.run.smithi071.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-21T06:58:05.854 INFO:teuthology.orchestra.run.smithi071.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-09-21T06:58:05.880 INFO:teuthology.orchestra.run.smithi071.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-09-21T06:58:05.891 INFO:teuthology.orchestra.run.smithi063.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 6.8 MB/s | 1.4 MB 00:00 2024-09-21T06:58:05.905 INFO:teuthology.orchestra.run.smithi071.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-21T06:58:05.930 INFO:teuthology.orchestra.run.smithi071.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-21T06:58:05.972 INFO:teuthology.orchestra.run.smithi071.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-21T06:58:05.992 INFO:teuthology.orchestra.run.smithi063.stdout:(156/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.7 MB/s | 2.3 MB 00:00 2024-09-21T06:58:06.031 INFO:teuthology.orchestra.run.smithi071.stdout:(55/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-09-21T06:58:06.047 INFO:teuthology.orchestra.run.smithi071.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-21T06:58:06.073 INFO:teuthology.orchestra.run.smithi071.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 4.0 MB/s | 171 kB 00:00 2024-09-21T06:58:06.098 INFO:teuthology.orchestra.run.smithi071.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T06:58:06.115 INFO:teuthology.orchestra.run.smithi071.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T06:58:06.149 INFO:teuthology.orchestra.run.smithi071.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-09-21T06:58:06.191 INFO:teuthology.orchestra.run.smithi071.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-21T06:58:06.216 INFO:teuthology.orchestra.run.smithi071.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 367 kB/s | 24 kB 00:00 2024-09-21T06:58:06.241 INFO:teuthology.orchestra.run.smithi071.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-21T06:58:06.266 INFO:teuthology.orchestra.run.smithi071.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-21T06:58:06.292 INFO:teuthology.orchestra.run.smithi071.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-21T06:58:06.317 INFO:teuthology.orchestra.run.smithi071.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-21T06:58:06.451 INFO:teuthology.orchestra.run.smithi071.stdout:(67/157): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-21T06:58:06.526 INFO:teuthology.orchestra.run.smithi071.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-21T06:58:06.568 INFO:teuthology.orchestra.run.smithi071.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-21T06:58:06.601 INFO:teuthology.orchestra.run.smithi071.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-21T06:58:06.635 INFO:teuthology.orchestra.run.smithi071.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T06:58:06.702 INFO:teuthology.orchestra.run.smithi071.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-21T06:58:06.786 INFO:teuthology.orchestra.run.smithi071.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 31 MB/s | 5.8 MB 00:00 2024-09-21T06:58:06.811 INFO:teuthology.orchestra.run.smithi071.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 807 kB/s | 87 kB 00:00 2024-09-21T06:58:06.861 INFO:teuthology.orchestra.run.smithi071.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T06:58:06.945 INFO:teuthology.orchestra.run.smithi071.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-09-21T06:58:06.970 INFO:teuthology.orchestra.run.smithi071.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-21T06:58:07.004 INFO:teuthology.orchestra.run.smithi071.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-21T06:58:07.029 INFO:teuthology.orchestra.run.smithi071.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-09-21T06:58:07.054 INFO:teuthology.orchestra.run.smithi071.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-21T06:58:07.079 INFO:teuthology.orchestra.run.smithi071.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-21T06:58:07.091 INFO:teuthology.orchestra.run.smithi063.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 2.4 MB 00:01 2024-09-21T06:58:07.098 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:58:07.098 INFO:teuthology.orchestra.run.smithi063.stdout:Total 22 MB/s | 228 MB 00:10 2024-09-21T06:58:07.104 INFO:teuthology.orchestra.run.smithi071.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-21T06:58:07.155 INFO:teuthology.orchestra.run.smithi071.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-21T06:58:07.230 INFO:teuthology.orchestra.run.smithi071.stdout:(84/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-09-21T06:58:07.255 INFO:teuthology.orchestra.run.smithi071.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-21T06:58:07.281 INFO:teuthology.orchestra.run.smithi071.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T06:58:07.306 INFO:teuthology.orchestra.run.smithi071.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-21T06:58:07.331 INFO:teuthology.orchestra.run.smithi071.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T06:58:07.357 INFO:teuthology.orchestra.run.smithi071.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T06:58:07.382 INFO:teuthology.orchestra.run.smithi071.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T06:58:07.407 INFO:teuthology.orchestra.run.smithi071.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T06:58:07.432 INFO:teuthology.orchestra.run.smithi071.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T06:58:07.474 INFO:teuthology.orchestra.run.smithi071.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-21T06:58:07.516 INFO:teuthology.orchestra.run.smithi071.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-21T06:58:07.558 INFO:teuthology.orchestra.run.smithi071.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-21T06:58:07.592 INFO:teuthology.orchestra.run.smithi071.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-09-21T06:58:07.759 INFO:teuthology.orchestra.run.smithi071.stdout:(97/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2024-09-21T06:58:07.776 INFO:teuthology.orchestra.run.smithi071.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 258 kB/s | 47 kB 00:00 2024-09-21T06:58:07.809 INFO:teuthology.orchestra.run.smithi071.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T06:58:07.826 INFO:teuthology.orchestra.run.smithi071.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T06:58:07.852 INFO:teuthology.orchestra.run.smithi071.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-21T06:58:07.877 INFO:teuthology.orchestra.run.smithi071.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T06:58:07.902 INFO:teuthology.orchestra.run.smithi071.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-21T06:58:08.194 INFO:teuthology.orchestra.run.smithi071.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 70 kB/s | 22 kB 00:00 2024-09-21T06:58:08.269 INFO:teuthology.orchestra.run.smithi071.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-21T06:58:08.303 INFO:teuthology.orchestra.run.smithi071.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-21T06:58:08.328 INFO:teuthology.orchestra.run.smithi071.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-09-21T06:58:08.381 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-09-21T06:58:08.445 INFO:teuthology.orchestra.run.smithi071.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T06:58:08.470 INFO:teuthology.orchestra.run.smithi071.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T06:58:08.495 INFO:teuthology.orchestra.run.smithi071.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T06:58:08.512 INFO:teuthology.orchestra.run.smithi071.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-09-21T06:58:08.538 INFO:teuthology.orchestra.run.smithi071.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T06:58:08.553 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-09-21T06:58:08.553 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-09-21T06:58:08.571 INFO:teuthology.orchestra.run.smithi071.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-21T06:58:08.613 INFO:teuthology.orchestra.run.smithi071.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T06:58:08.639 INFO:teuthology.orchestra.run.smithi071.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T06:58:08.664 INFO:teuthology.orchestra.run.smithi071.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T06:58:08.689 INFO:teuthology.orchestra.run.smithi071.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-21T06:58:08.714 INFO:teuthology.orchestra.run.smithi071.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T06:58:08.748 INFO:teuthology.orchestra.run.smithi071.stdout:(119/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-09-21T06:58:08.790 INFO:teuthology.orchestra.run.smithi071.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-21T06:58:08.823 INFO:teuthology.orchestra.run.smithi071.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 6.8 MB/s | 220 kB 00:00 2024-09-21T06:58:08.865 INFO:teuthology.orchestra.run.smithi071.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-09-21T06:58:09.224 INFO:teuthology.orchestra.run.smithi071.stdout:(123/157): ceph-test-19.3.0-5120.g18432218.el9. 5.8 MB/s | 40 MB 00:06 2024-09-21T06:58:09.258 INFO:teuthology.orchestra.run.smithi071.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 369 kB/s | 144 kB 00:00 2024-09-21T06:58:09.275 INFO:teuthology.orchestra.run.smithi071.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 215 kB/s | 11 kB 00:00 2024-09-21T06:58:09.291 INFO:teuthology.orchestra.run.smithi071.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 561 kB/s | 18 kB 00:00 2024-09-21T06:58:09.308 INFO:teuthology.orchestra.run.smithi071.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 1.2 MB/s | 19 kB 00:00 2024-09-21T06:58:09.325 INFO:teuthology.orchestra.run.smithi071.stdout:(128/157): python3-jaraco-collections-3.0.0-8.e 696 kB/s | 23 kB 00:00 2024-09-21T06:58:09.342 INFO:teuthology.orchestra.run.smithi071.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 586 kB/s | 20 kB 00:00 2024-09-21T06:58:09.367 INFO:teuthology.orchestra.run.smithi071.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:58:09.393 INFO:teuthology.orchestra.run.smithi071.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:58:09.418 INFO:teuthology.orchestra.run.smithi071.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:58:09.477 INFO:teuthology.orchestra.run.smithi071.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-21T06:58:09.502 INFO:teuthology.orchestra.run.smithi071.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-21T06:58:09.536 INFO:teuthology.orchestra.run.smithi071.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-21T06:58:09.561 INFO:teuthology.orchestra.run.smithi071.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-21T06:58:09.586 INFO:teuthology.orchestra.run.smithi071.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-21T06:58:09.611 INFO:teuthology.orchestra.run.smithi071.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-21T06:58:09.637 INFO:teuthology.orchestra.run.smithi071.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T06:58:09.662 INFO:teuthology.orchestra.run.smithi071.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T06:58:09.687 INFO:teuthology.orchestra.run.smithi071.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-21T06:58:09.721 INFO:teuthology.orchestra.run.smithi071.stdout:(142/157): python3-kubernetes-26.1.0-2.el9.noar 2.6 MB/s | 1.0 MB 00:00 2024-09-21T06:58:09.746 INFO:teuthology.orchestra.run.smithi071.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 888 kB/s | 74 kB 00:00 2024-09-21T06:58:09.771 INFO:teuthology.orchestra.run.smithi071.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T06:58:09.797 INFO:teuthology.orchestra.run.smithi071.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-21T06:58:09.822 INFO:teuthology.orchestra.run.smithi071.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-21T06:58:09.847 INFO:teuthology.orchestra.run.smithi071.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T06:58:09.872 INFO:teuthology.orchestra.run.smithi071.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T06:58:09.923 INFO:teuthology.orchestra.run.smithi071.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T06:58:10.415 INFO:teuthology.orchestra.run.smithi071.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 5.8 MB/s | 3.2 MB 00:00 2024-09-21T06:58:10.464 INFO:teuthology.orchestra.run.smithi071.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.3 MB/s | 2.3 MB 00:00 2024-09-21T06:58:10.515 INFO:teuthology.orchestra.run.smithi071.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 819 kB/s | 41 kB 00:00 2024-09-21T06:58:10.598 INFO:teuthology.orchestra.run.smithi071.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.9 MB/s | 249 kB 00:00 2024-09-21T06:58:10.723 INFO:teuthology.orchestra.run.smithi071.stdout:(154/157): librados2-19.3.0-5120.g18432218.el9. 3.9 MB/s | 3.4 MB 00:00 2024-09-21T06:58:10.840 INFO:teuthology.orchestra.run.smithi071.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 5.6 MB/s | 1.4 MB 00:00 2024-09-21T06:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-09-21T06:58:10.920 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-09-21T06:58:11.099 INFO:teuthology.orchestra.run.smithi071.stdout:(156/157): NetworkManager-libnm-1.51.0-1.el9.x8 2.6 MB/s | 1.8 MB 00:00 2024-09-21T06:58:11.441 INFO:teuthology.orchestra.run.smithi071.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 2.4 MB 00:00 2024-09-21T06:58:11.446 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:58:11.446 INFO:teuthology.orchestra.run.smithi071.stdout:Total 21 MB/s | 228 MB 00:10 2024-09-21T06:58:12.663 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-21T06:58:12.813 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-21T06:58:12.814 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-21T06:58:15.053 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-21T06:58:15.053 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-21T06:58:17.554 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-09-21T06:58:17.654 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:58:17.765 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:58:17.961 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:58:18.022 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:58:18.046 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:58:18.107 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:58:18.475 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:58:18.581 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:58:18.694 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:58:18.723 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:58:18.808 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:58:18.836 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:58:18.866 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:58:19.046 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:58:19.101 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:58:19.128 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:58:19.229 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:58:19.254 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:58:19.309 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:58:19.338 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:58:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:58:19.559 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:58:19.738 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:58:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:58:20.014 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:58:20.087 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:58:20.325 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:58:20.444 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:58:20.475 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:58:20.511 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:58:20.587 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:58:20.650 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:58:20.693 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:58:20.752 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:58:20.794 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:58:20.824 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:58:20.939 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:58:21.015 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:58:21.053 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:58:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:58:21.225 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:58:21.267 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:58:21.308 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:58:21.335 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:58:21.410 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:58:21.458 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:58:21.537 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:58:21.595 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-21T06:58:21.682 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:58:21.711 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:58:21.737 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:58:21.844 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:58:22.011 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:58:22.070 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:58:22.103 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:58:22.153 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:58:22.302 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:58:22.392 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:58:22.426 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:58:22.469 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:58:22.498 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:58:22.507 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:58:22.550 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:58:22.621 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:58:22.728 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:58:22.755 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:58:22.785 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:58:22.788 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:58:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:58:22.882 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:58:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:58:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:58:22.942 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:58:23.026 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:58:23.062 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:58:23.098 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:58:23.122 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:58:23.146 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:58:23.180 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:58:23.181 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:58:23.210 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:58:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:58:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:58:23.384 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:58:23.415 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:58:23.425 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:58:23.446 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:58:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:58:23.569 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:58:23.626 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:58:23.647 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:58:23.668 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:58:23.775 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:58:23.809 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:58:23.827 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:58:23.849 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:58:23.885 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:58:23.910 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:58:23.942 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:58:24.014 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:58:24.057 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:58:24.136 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:58:24.151 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:58:24.192 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:58:24.220 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:58:24.254 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:58:24.294 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:58:24.334 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:58:24.348 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:58:24.363 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:58:24.398 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:58:24.431 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:58:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:58:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:58:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:58:24.507 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:58:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:58:24.597 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:58:24.598 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:58:24.647 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:58:24.650 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:58:24.685 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:58:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:58:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:58:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:58:24.794 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:58:24.820 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:58:24.846 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:58:24.887 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:58:24.950 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:58:24.987 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:58:25.025 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:58:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:58:25.144 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:58:25.188 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:58:25.216 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:58:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:58:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:58:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:58:25.537 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:58:25.591 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:58:25.611 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:58:25.666 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:58:25.698 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:58:25.804 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:58:26.084 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:58:26.118 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:58:26.192 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:58:26.203 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:58:26.232 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:58:26.275 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:58:26.290 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:58:26.322 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:58:26.326 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:58:26.372 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:58:26.527 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:58:26.541 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:58:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:58:26.608 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:58:26.653 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:58:26.697 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:58:26.763 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:58:26.835 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:58:26.876 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:58:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:58:26.967 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:58:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:58:27.046 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:58:27.088 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:58:27.223 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:58:27.265 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:58:27.306 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:58:27.362 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:58:27.486 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:58:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:58:27.591 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:58:27.643 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:58:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:58:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:58:27.795 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:58:27.930 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:58:27.972 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:58:27.999 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:58:28.033 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:58:28.073 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:58:28.112 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:58:28.142 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:58:28.180 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:58:28.213 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:58:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:58:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:58:28.374 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:58:28.428 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:58:28.459 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:58:28.561 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:58:28.609 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:58:28.811 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:58:28.894 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:58:28.923 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:58:28.955 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:58:29.300 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:58:29.318 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:58:29.343 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:58:29.365 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:58:29.432 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:58:29.444 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:58:29.473 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:58:29.509 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:58:29.532 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:58:29.587 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:58:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:58:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:58:29.752 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:58:29.934 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:58:30.045 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:58:30.079 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:58:30.134 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:58:30.164 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:58:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:58:30.346 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:58:31.021 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:58:31.145 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:58:32.381 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:58:32.468 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:58:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:58:32.515 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:58:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:58:32.552 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:58:32.858 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:58:32.910 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:58:33.102 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:58:33.139 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:58:33.157 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:58:33.183 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:58:33.205 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:58:33.283 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:58:33.283 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:58:33.283 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:58:33.283 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:58:33.323 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:58:33.688 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:58:33.720 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:58:33.791 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:58:33.814 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:58:36.134 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:58:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:58:36.749 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:58:36.787 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:58:36.881 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:58:36.882 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:58:36.882 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:58:36.882 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:58:36.922 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:58:45.424 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:58:45.424 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /sys 2024-09-21T06:58:45.424 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /proc 2024-09-21T06:58:45.424 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /mnt 2024-09-21T06:58:45.424 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /var/tmp 2024-09-21T06:58:45.424 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /home 2024-09-21T06:58:45.424 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /root 2024-09-21T06:58:45.424 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /tmp 2024-09-21T06:58:45.424 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:58:45.599 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:58:45.616 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:58:45.616 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:45.617 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:58:45.617 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:58:47.294 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:58:47.322 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:58:47.323 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:47.323 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:58:47.323 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:58:47.323 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:58:47.323 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:58:47.561 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:58:47.586 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:58:47.586 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:47.587 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:58:47.587 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:58:47.587 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:58:47.587 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:58:48.079 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:58:48.104 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:58:48.104 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:48.104 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:58:48.104 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:58:48.104 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:58:48.104 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:58:48.209 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:58:48.268 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:58:48.331 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:58:48.536 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:58:48.588 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:58:48.669 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:58:48.759 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:58:48.786 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:58:48.786 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-09-21T06:58:48.786 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-09-21T06:58:48.786 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-09-21T06:58:48.786 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-09-21T06:58:48.786 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-09-21T06:58:48.787 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2024-09-21T06:58:48.787 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-09-21T06:58:48.787 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:58:48.910 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:58:48.954 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:58:48.957 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:58:48.973 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:58:48.973 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:48.973 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:58:48.973 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:58:48.986 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:58:49.013 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:58:49.483 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:58:49.512 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:58:49.545 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:58:49.613 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:58:49.644 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:58:50.578 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:58:50.605 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:58:50.605 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:50.605 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:58:50.605 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:58:50.606 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:58:50.606 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:58:50.837 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:58:50.860 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:58:50.860 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:50.860 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:58:50.860 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:58:50.861 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:58:50.861 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:58:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:58:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:58:51.353 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:51.353 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:58:51.353 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:58:51.353 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:58:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:58:51.459 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:58:51.516 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:58:51.580 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:58:51.772 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:58:51.821 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:58:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:58:51.995 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:58:52.135 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:58:52.179 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:58:52.211 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:58:52.239 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:58:52.607 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:58:52.646 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:58:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:58:52.744 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:58:52.769 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:58:53.031 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:58:53.099 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:58:54.118 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:58:54.141 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:58:54.264 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:58:54.433 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:58:54.461 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:58:54.486 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:58:54.486 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:54.486 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:58:54.486 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:58:54.486 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:58:54.486 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:58:54.527 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:58:54.539 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:58:54.642 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:58:54.701 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:58:55.723 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:58:55.754 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:58:55.780 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:58:55.780 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:55.780 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:58:55.780 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:58:55.780 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:58:55.780 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:58:55.822 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:58:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:58:55.847 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:55.847 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:58:55.847 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:58:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:58:55.922 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:58:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:58:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:58:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:58:55.923 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:58:55.924 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:58:55.983 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:58:56.256 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:58:56.281 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:58:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:58:56.967 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:58:57.079 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:58:57.242 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:58:57.277 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:58:57.301 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:58:57.302 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:57.302 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:58:57.302 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:58:57.302 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:58:57.302 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:58:57.353 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:58:57.365 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:58:57.462 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:58:57.536 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:58:58.507 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:58:58.538 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:58:58.563 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:58:58.563 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:58.563 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:58:58.563 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:58:58.563 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:58:58.564 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:58:58.606 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:58:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:58:58.629 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:58.629 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:58:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:58:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:58:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:58:58.713 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:58.713 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:58:58.713 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:58:58.713 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:58:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:58:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:58:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:58:59.065 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:58:59.066 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:58:59.066 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:58:59.066 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:58:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:00.543 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:59:00.586 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:59:00.626 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:59:00.658 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:59:00.685 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:59:00.912 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:59:00.957 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:59:00.986 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:59:01.016 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:59:01.054 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:59:01.690 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:59:01.735 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:59:01.756 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:59:02.658 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:59:02.739 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:59:02.786 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:59:02.877 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:59:02.908 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:59:02.933 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:59:02.959 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:59:02.959 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:59:03.060 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:59:03.060 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:59:03.076 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:59:03.118 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:59:03.127 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:59:03.159 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:59:03.161 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:59:03.166 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:59:03.167 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:59:03.191 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:59:03.218 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:59:03.355 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:59:03.355 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:59:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:59:03.439 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:59:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:59:03.507 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:59:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:59:03.541 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:59:03.580 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:59:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:59:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:59:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:59:05.096 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:59:05.173 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:59:05.233 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:59:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:59:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:59:05.376 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:59:05.410 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:59:05.410 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:59:05.494 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:59:05.495 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:59:05.579 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:59:05.604 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:59:05.609 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:59:05.609 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:59:05.780 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:59:05.780 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:59:05.873 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:59:05.938 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:59:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:59:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:59:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:59:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:59:09.857 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:59:09.858 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:59:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:59:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:59:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:59:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:59:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:59:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:59:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:59:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:59:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:59:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:59:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:59:09.859 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:59:09.870 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:59:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:59:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:59:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:59:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:59:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:59:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:59:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:59:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:59:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:59:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:59:09.871 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:59:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:59:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:59:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:59:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:59:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:59:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:59:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:59:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:59:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:59:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:59:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:59:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:59:09.872 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:59:09.873 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:59:09.874 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:59:09.875 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:59:09.876 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:59:09.877 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:59:09.878 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:59:09.879 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:59:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:59:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:59:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:59:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:59:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:59:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:59:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:59:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:59:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:59:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:59:09.880 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:59:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:59:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:12.590 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2024-09-21T06:59:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:59:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:59:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:59:12.590 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.591 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.592 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:59:12.593 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:59:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:59:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:59:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:59:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:59:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:59:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:59:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:59:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.594 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:59:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:59:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:59:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:59:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:59:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:59:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:59:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:59:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:59:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:59:12.595 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.596 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:59:12.597 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:59:12.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:59:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:59:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:59:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:59:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:59:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:59:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:59:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:59:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:59:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:59:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:59:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:59:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:59:12.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:59:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:59:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:59:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:59:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:59:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:59:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:59:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:59:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:59:12.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:59:12.601 INFO:teuthology.orchestra.run.smithi063.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:59:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:59:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:59:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:59:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:59:12.602 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:12.602 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-09-21T06:59:12.682 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:59:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:59:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:59:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:59:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:59:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:59:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:59:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:59:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:59:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:59:12.683 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:59:12.684 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:59:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:59:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:59:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:59:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:59:12.685 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:59:12.695 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:59:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:59:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:59:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:59:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:59:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:59:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:59:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:59:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:59:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:59:12.696 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:59:12.697 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:59:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:59:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:59:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:59:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:59:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:59:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:59:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:59:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:59:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:59:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:59:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:59:12.698 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:59:12.699 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:59:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:59:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:59:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:59:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:59:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:59:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:59:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:59:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:59:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:59:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:59:12.700 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:59:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:59:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:59:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:59:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:59:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:59:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:59:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:59:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:59:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:59:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:59:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:59:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:59:12.701 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:59:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:59:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:59:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:59:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:59:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:59:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:59:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:59:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:59:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:59:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:59:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:59:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:59:12.702 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:59:12.703 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:59:12.703 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:59:12.703 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:59:12.703 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:59:12.703 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:59:12.703 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:59:12.703 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:59:12.703 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:59:12.703 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:59:12.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:59:12.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:59:12.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:59:12.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:59:12.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:59:12.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:59:12.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:59:12.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:59:12.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:59:12.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:59:12.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:59:12.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:59:12.704 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:59:12.705 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:59:12.706 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:59:12.706 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:59:12.706 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:59:12.706 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:59:12.706 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:59:12.706 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:59:12.706 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:59:12.706 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:59:12.706 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:59:12.706 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:59:12.994 DEBUG:teuthology.parallel:result is None 2024-09-21T06:59:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:59:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:15.514 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-09-21T06:59:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:59:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:59:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:59:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:59:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:59:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:59:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:59:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:59:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:59:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:59:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:59:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:59:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:59:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:59:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:59:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:59:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:15.525 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-21T06:59:15.959 DEBUG:teuthology.parallel:result is None 2024-09-21T06:59:15.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:59:16.118 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:59:16.148 INFO:teuthology.orchestra.run.smithi063.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:59:16.149 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:59:16.149 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:59:16.151 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:59:16.303 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:59:16.329 INFO:teuthology.orchestra.run.smithi071.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:59:16.329 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:59:16.329 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:59:16.331 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T06:59:16.332 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:16.332 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:59:16.369 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:16.369 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:59:16.400 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T06:59:16.400 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:16.400 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:59:16.442 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:59:16.513 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:16.514 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:59:16.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:59:16.614 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T06:59:16.614 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:16.614 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:59:16.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:59:16.720 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:16.720 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:59:16.747 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:59:16.814 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T06:59:16.814 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:16.815 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:59:16.846 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:59:16.916 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:16.917 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:59:16.944 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:59:17.009 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T06:59:17.093 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T06:59:17.093 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2024-09-21T06:59:17.095 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2024-09-21T06:59:17.123 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T06:59:17.124 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T06:59:17.166 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T06:59:17.193 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T06:59:17.194 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T06:59:17.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T06:59:17.270 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-21T06:59:17.270 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-21T06:59:17.270 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-21T06:59:17.270 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:17.270 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T06:59:17.321 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T06:59:17.439 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T06:59:17.467 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:17.468 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-21T06:59:17.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-21T06:59:17.590 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-21T06:59:17.620 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T06:59:17.621 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T06:59:17.621 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913577', 'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/recovery-fs}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7913577', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240920.212106-debug'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240920.212106-debug', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7864, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'sleep_before_teardown': 0, 'subset': '67/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240920.212106-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+DpooFHDcGuSzv4WDQIupHUDVikLNJoNiv3mME8bruShy6hGpyieQERjf/UpNvz3eFvB/FsS88/reUxKMx+SY=', 'smithi071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMpX1Ta/1FFvfCVllxSTADrG7JawjikN/FeOaViLwGGLjRRNCy8nFC1Zaf9nxYtfr5f71pO9bsvGWQZNq9JVJ0k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_recovery_fs']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-20_23:48:22', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T06:59:17.621 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T06:59:17.624 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T06:59:17.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T06:59:17.682 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T06:59:17.734 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:17.734 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:59:17.764 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:59:17.765 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-09-21T06:59:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:59:17.822 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:59:17.823 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-21T06:59:17.823 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:59:17.823 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:59:17.823 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-21 06:59:03.879394390 +0000 2024-09-21T06:59:17.823 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-21 06:57:17.471101651 +0000 2024-09-21T06:59:17.823 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-21 06:57:17.471101651 +0000 2024-09-21T06:59:17.824 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-21 06:57:17.471101651 +0000 2024-09-21T06:59:17.824 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:59:17.888 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-21T06:59:17.888 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-21T06:59:17.888 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000225732 s, 2.3 MB/s 2024-09-21T06:59:17.890 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:59:17.947 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-09-21T06:59:18.004 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:59:18.004 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:59:18.004 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T06:59:18.005 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:59:18.005 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:59:18.005 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-21 06:59:03.880394381 +0000 2024-09-21T06:59:18.005 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-21 06:57:17.811098651 +0000 2024-09-21T06:59:18.005 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-21 06:57:17.811098651 +0000 2024-09-21T06:59:18.005 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-21 06:57:17.811098651 +0000 2024-09-21T06:59:18.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:59:18.070 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-21T06:59:18.070 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-21T06:59:18.070 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000175015 s, 2.9 MB/s 2024-09-21T06:59:18.071 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:59:18.129 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-09-21T06:59:18.186 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:59:18.186 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:59:18.186 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T06:59:18.186 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:59:18.186 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:59:18.186 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-21 06:59:03.880394381 +0000 2024-09-21T06:59:18.186 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-21 06:57:18.132095819 +0000 2024-09-21T06:59:18.186 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-21 06:57:18.132095819 +0000 2024-09-21T06:59:18.186 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-21 06:57:18.132095819 +0000 2024-09-21T06:59:18.187 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:59:18.250 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-21T06:59:18.250 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-21T06:59:18.250 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000187806 s, 2.7 MB/s 2024-09-21T06:59:18.252 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:59:18.309 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-09-21T06:59:18.365 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:59:18.365 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:59:18.365 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T06:59:18.365 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:59:18.365 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:59:18.366 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-09-21 06:59:03.880394381 +0000 2024-09-21T06:59:18.366 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-09-21 06:57:18.467092864 +0000 2024-09-21T06:59:18.366 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-09-21 06:57:18.467092864 +0000 2024-09-21T06:59:18.366 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-09-21 06:57:18.467092864 +0000 2024-09-21T06:59:18.366 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:59:18.431 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-09-21T06:59:18.431 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-09-21T06:59:18.431 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000187647 s, 2.7 MB/s 2024-09-21T06:59:18.432 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:59:18.490 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:59:18.490 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:18.490 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:59:18.509 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:59:18.509 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-09-21T06:59:18.566 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:59:18.567 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:59:18.567 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T06:59:18.567 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:59:18.567 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:59:18.567 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-21 06:59:06.269017391 +0000 2024-09-21T06:59:18.567 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-21 06:57:14.906103696 +0000 2024-09-21T06:59:18.567 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-21 06:57:14.906103696 +0000 2024-09-21T06:59:18.567 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-21 06:57:14.906103696 +0000 2024-09-21T06:59:18.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:59:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-21T06:59:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-21T06:59:18.634 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000238899 s, 2.1 MB/s 2024-09-21T06:59:18.635 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:59:18.693 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-09-21T06:59:18.750 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:59:18.750 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:59:18.750 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T06:59:18.750 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:59:18.751 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:59:18.751 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-21 06:59:06.269017391 +0000 2024-09-21T06:59:18.751 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-21 06:57:15.246098102 +0000 2024-09-21T06:59:18.751 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-21 06:57:15.246098102 +0000 2024-09-21T06:59:18.751 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-21 06:57:15.246098102 +0000 2024-09-21T06:59:18.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:59:18.816 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-21T06:59:18.816 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-21T06:59:18.816 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00021259 s, 2.4 MB/s 2024-09-21T06:59:18.817 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:59:18.874 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-09-21T06:59:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:59:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:59:18.930 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T06:59:18.930 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:59:18.931 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:59:18.931 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-21 06:59:06.269017391 +0000 2024-09-21T06:59:18.931 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-21 06:57:15.561092919 +0000 2024-09-21T06:59:18.931 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-21 06:57:15.561092919 +0000 2024-09-21T06:59:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-21 06:57:15.561092919 +0000 2024-09-21T06:59:18.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:59:18.994 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-21T06:59:18.995 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-21T06:59:18.995 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000252163 s, 2.0 MB/s 2024-09-21T06:59:18.996 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:59:19.053 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-09-21T06:59:19.109 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:59:19.109 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:59:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-21T06:59:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:59:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:59:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-21 06:59:06.270017375 +0000 2024-09-21T06:59:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-21 06:57:15.885087588 +0000 2024-09-21T06:59:19.109 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-21 06:57:15.885087588 +0000 2024-09-21T06:59:19.109 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-21 06:57:15.885087588 +0000 2024-09-21T06:59:19.110 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:59:19.172 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-21T06:59:19.173 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-21T06:59:19.173 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000192563 s, 2.7 MB/s 2024-09-21T06:59:19.174 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:59:19.231 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:59:19.231 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T06:59:19.231 INFO:tasks.ceph:Generating config... 2024-09-21T06:59:19.232 INFO:tasks.ceph:[client] pid file = 2024-09-21T06:59:19.232 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-21T06:59:19.232 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T06:59:19.232 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T06:59:19.232 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T06:59:19.232 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T06:59:19.232 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T06:59:19.232 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T06:59:19.233 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T06:59:19.234 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T06:59:19.234 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T06:59:19.303 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T06:59:19.307 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T06:59:19.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T06:59:19.391 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.63'), ('mon.b', '172.21.15.71'), ('mon.c', '[v2:172.21.15.71:3301,v1:172.21.15.71:6790]')] 2024-09-21T06:59:19.392 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.63,172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-21T06:59:19.392 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:19.392 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T06:59:19.448 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.63 --add b 172.21.15.71 --addv c '[v2:172.21.15.71:3301,v1:172.21.15.71:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:19.546 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:19.547 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: generated fsid 2c317557-147d-48e9-8f3c-bb88131d3e37 2024-09-21T06:59:19.547 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = quincy 2024-09-21T06:59:19.547 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 0 2024-09-21T06:59:19.547 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 2c317557-147d-48e9-8f3c-bb88131d3e37 2024-09-21T06:59:19.547 INFO:teuthology.orchestra.run.smithi063.stdout:last_changed 2024-09-21T06:59:19.546094+0000 2024-09-21T06:59:19.547 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-09-21T06:59:19.546094+0000 2024-09-21T06:59:19.547 INFO:teuthology.orchestra.run.smithi063.stdout:min_mon_release 17 (quincy) 2024-09-21T06:59:19.547 INFO:teuthology.orchestra.run.smithi063.stdout:election_strategy: 1 2024-09-21T06:59:19.547 INFO:teuthology.orchestra.run.smithi063.stdout:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-09-21T06:59:19.547 INFO:teuthology.orchestra.run.smithi063.stdout:1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.b 2024-09-21T06:59:19.547 INFO:teuthology.orchestra.run.smithi063.stdout:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-09-21T06:59:19.547 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-21T06:59:19.548 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T06:59:19.564 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2c317557-147d-48e9-8f3c-bb88131d3e37... 2024-09-21T06:59:19.564 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T06:59:19.606 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T06:59:19.650 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-09-21T06:59:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2024-09-21T06:59:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T06:59:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2024-09-21T06:59:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2024-09-21T06:59:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2024-09-21T06:59:19.650 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.651 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.652 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790]" 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on skipped message = False 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 2c317557-147d-48e9-8f3c-bb88131d3e37 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2024-09-21T06:59:19.653 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug trim objects = true 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.654 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: bdev async discard = True 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: bdev enable discard = True 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = bitmap 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 1/20 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 1/20 2024-09-21T06:59:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-21T06:59:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2024-09-21T06:59:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 4/10 2024-09-21T06:59:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T06:59:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2024-09-21T06:59:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2024-09-21T06:59:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2024-09-21T06:59:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2024-09-21T06:59:19.656 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.657 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2024-09-21T06:59:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-21T06:59:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2024-09-21T06:59:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-21T06:59:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-21T06:59:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-21T06:59:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-21T06:59:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2024-09-21T06:59:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.658 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2024-09-21T06:59:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-09-21T06:59:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-09-21T06:59:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2024-09-21T06:59:19.658 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-09-21T06:59:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2024-09-21T06:59:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2024-09-21T06:59:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-09-21T06:59:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2024-09-21T06:59:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2024-09-21T06:59:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-09-21T06:59:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T06:59:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T06:59:19.659 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: mon down mkfs grace = 300 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2024-09-21T06:59:19.660 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2024-09-21T06:59:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T06:59:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T06:59:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2024-09-21T06:59:19.661 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2024-09-21T06:59:19.661 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2024-09-21T06:59:19.661 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2024-09-21T06:59:19.661 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2024-09-21T06:59:19.661 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c] 2024-09-21T06:59:19.661 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2024-09-21T06:59:19.661 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d] 2024-09-21T06:59:19.662 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2024-09-21T06:59:19.662 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2024-09-21T06:59:19.662 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T06:59:19.662 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2024-09-21T06:59:19.662 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.662 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2024-09-21T06:59:19.662 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.662 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2024-09-21T06:59:19.662 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.662 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2024-09-21T06:59:19.662 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2024-09-21T06:59:19.662 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2024-09-21T06:59:19.663 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2024-09-21T06:59:19.664 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2024-09-21T06:59:19.665 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.63,172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790]" 2024-09-21T06:59:19.665 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on skipped message = False 2024-09-21T06:59:19.665 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 2c317557-147d-48e9-8f3c-bb88131d3e37 2024-09-21T06:59:19.665 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.665 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2024-09-21T06:59:19.665 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2024-09-21T06:59:19.665 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.665 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2024-09-21T06:59:19.665 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2024-09-21T06:59:19.665 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2024-09-21T06:59:19.665 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.665 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug trim objects = true 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2024-09-21T06:59:19.666 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: bdev async discard = True 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: bdev enable discard = True 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore allocator = bitmap 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore block size = 96636764160 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore fsck on mount = True 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluefs = 1/20 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluestore = 1/20 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-21T06:59:19.667 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2024-09-21T06:59:19.668 INFO:teuthology.orchestra.run.smithi071.stdout: debug rocksdb = 4/10 2024-09-21T06:59:19.668 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T06:59:19.668 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd full ratio = 0.9 2024-09-21T06:59:19.668 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd nearfull ratio = 0.8 2024-09-21T06:59:19.668 INFO:teuthology.orchestra.run.smithi071.stdout: osd failsafe full ratio = 0.95 2024-09-21T06:59:19.668 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = bluestore 2024-09-21T06:59:19.668 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.668 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2024-09-21T06:59:19.668 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-21T06:59:19.668 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2024-09-21T06:59:19.668 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-09-21T06:59:19.668 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-09-21T06:59:19.668 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-09-21T06:59:19.669 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-09-21T06:59:19.669 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2024-09-21T06:59:19.669 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.669 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2024-09-21T06:59:19.669 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-09-21T06:59:19.669 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-09-21T06:59:19.669 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2024-09-21T06:59:19.669 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-09-21T06:59:19.669 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T06:59:19.670 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.671 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2024-09-21T06:59:19.671 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2024-09-21T06:59:19.671 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.671 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2024-09-21T06:59:19.671 INFO:teuthology.orchestra.run.smithi071.stdout: mon down mkfs grace = 300 2024-09-21T06:59:19.671 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-21T06:59:19.671 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2024-09-21T06:59:19.671 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2024-09-21T06:59:19.671 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2024-09-21T06:59:19.671 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2024-09-21T06:59:19.671 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T06:59:19.672 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T06:59:19.672 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = "" 2024-09-21T06:59:19.672 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2024-09-21T06:59:19.672 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2024-09-21T06:59:19.672 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2024-09-21T06:59:19.672 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2024-09-21T06:59:19.672 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.c] 2024-09-21T06:59:19.672 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2024-09-21T06:59:19.672 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.d] 2024-09-21T06:59:19.673 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T06:59:19.673 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T06:59:19.780 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T06:59:19.780 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:19.780 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T06:59:19.796 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:19.796 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T06:59:19.852 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:59:19.853 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:19.853 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T06:59:19.853 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T06:59:19.929 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:19.929 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:19.985 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T06:59:19.985 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:19.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T06:59:19.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T06:59:20.024 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:20.024 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:20.081 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T06:59:20.082 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T06:59:20.082 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T06:59:20.145 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T06:59:20.148 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T06:59:20.228 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T06:59:20.231 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T06:59:20.231 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T06:59:20.293 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-21T06:59:20.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-21T06:59:20.322 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T06:59:20.425 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-21T06:59:20.428 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-21T06:59:20.452 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T06:59:20.516 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-21T06:59:20.519 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-21T06:59:20.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T06:59:20.643 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-21T06:59:20.646 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-21T06:59:20.671 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T06:59:20.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T06:59:20.722 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T06:59:20.736 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-21T06:59:20.787 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-21T06:59:20.801 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T06:59:20.851 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T06:59:20.864 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-21T06:59:20.913 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-21T06:59:20.926 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T06:59:20.926 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T06:59:20.926 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T06:59:20.952 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:59:20.953 INFO:tasks.ceph:role: osd.0 2024-09-21T06:59:20.953 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:59:20.953 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T06:59:21.026 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:59:21.026 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:59:21.026 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:59:21.026 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:59:21.026 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:59:21.026 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:59:21.026 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:59:21.026 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:59:21.026 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:59:21.026 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:59:21.517 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-21T06:59:21.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-21T06:59:21.519 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T06:59:21.661 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T06:59:21.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T06:59:21.763 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:59:21.764 INFO:tasks.ceph:role: osd.1 2024-09-21T06:59:21.764 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:59:21.764 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T06:59:21.837 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:59:21.837 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:59:21.838 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:59:21.838 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:59:21.838 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:59:21.838 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:59:21.838 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:59:21.838 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:59:21.838 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:59:21.838 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:59:22.301 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-21T06:59:22.303 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-21T06:59:22.303 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T06:59:22.401 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T06:59:22.435 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T06:59:22.503 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:59:22.503 INFO:tasks.ceph:role: osd.2 2024-09-21T06:59:22.503 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:59:22.503 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T06:59:22.578 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:59:22.578 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:59:22.578 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:59:22.578 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:59:22.578 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:59:22.578 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:59:22.578 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:59:22.578 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:59:22.578 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:59:22.578 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:59:23.063 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-21T06:59:23.065 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-21T06:59:23.065 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-21T06:59:23.199 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T06:59:23.234 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T06:59:23.303 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T06:59:23.303 INFO:tasks.ceph:role: osd.3 2024-09-21T06:59:23.303 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T06:59:23.303 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T06:59:23.378 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:59:23.379 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:59:23.379 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:59:23.379 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:59:23.379 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:59:23.379 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:59:23.379 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:59:23.379 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:59:23.379 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:59:23.379 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:59:23.888 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-09-21T06:59:23.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-09-21T06:59:23.890 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-21T06:59:24.043 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T06:59:24.079 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:24.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:24.196+0000 7fda56287640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T06:59:24.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:24.196+0000 7fda56287640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T06:59:24.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:24.196+0000 7fda56287640 -1 bdev(0x555582603900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-21T06:59:24.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:24.196+0000 7fda56287640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T06:59:27.379 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T06:59:27.410 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:27.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:27.514+0000 7f77aeefe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T06:59:27.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:27.515+0000 7f77aeefe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T06:59:27.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:27.515+0000 7f77aeefe640 -1 bdev(0x561e3190b900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-21T06:59:27.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:27.515+0000 7f77aeefe640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T06:59:30.435 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T06:59:30.465 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:30.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:30.567+0000 7fc324a87640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T06:59:30.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:30.568+0000 7fc324a87640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T06:59:30.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:30.568+0000 7fc324a87640 -1 bdev(0x55b03fbd3900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-21T06:59:30.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:30.568+0000 7fc324a87640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T06:59:33.734 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T06:59:33.764 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:33.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:33.866+0000 7f4295989640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T06:59:33.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:33.866+0000 7f4295989640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T06:59:33.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:33.866+0000 7f4295989640 -1 bdev(0x563b11be5900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-21T06:59:33.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:33.866+0000 7f4295989640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T06:59:36.780 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T06:59:36.812 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-21T06:59:36.841 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:59:36.842 INFO:tasks.ceph:role: osd.4 2024-09-21T06:59:36.842 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T06:59:36.842 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T06:59:36.918 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:59:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:59:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:59:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:59:36.918 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:59:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:59:36.918 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:59:36.918 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:59:36.918 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:59:36.918 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:59:37.417 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-21T06:59:37.419 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-21T06:59:37.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-21T06:59:37.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-21T06:59:37.582 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-21T06:59:37.647 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:59:37.647 INFO:tasks.ceph:role: osd.5 2024-09-21T06:59:37.647 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T06:59:37.647 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T06:59:37.719 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:59:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:59:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:59:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:59:37.720 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:59:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:59:37.720 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:59:37.720 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:59:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:59:37.720 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:59:38.170 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-21T06:59:38.173 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-21T06:59:38.173 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-21T06:59:38.263 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-21T06:59:38.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-21T06:59:38.357 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:59:38.357 INFO:tasks.ceph:role: osd.6 2024-09-21T06:59:38.357 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T06:59:38.357 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T06:59:38.429 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:59:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:59:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:59:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:59:38.429 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:59:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:59:38.429 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:59:38.429 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:59:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:59:38.430 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:59:38.926 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-21T06:59:38.928 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-21T06:59:38.928 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-21T06:59:39.047 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-21T06:59:39.078 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-21T06:59:39.142 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T06:59:39.143 INFO:tasks.ceph:role: osd.7 2024-09-21T06:59:39.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T06:59:39.143 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T06:59:39.214 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T06:59:39.214 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T06:59:39.214 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T06:59:39.214 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T06:59:39.215 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T06:59:39.215 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-09-21T06:59:39.215 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T06:59:39.215 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T06:59:39.215 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T06:59:39.215 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T06:59:39.729 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-09-21T06:59:39.732 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-09-21T06:59:39.733 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-21T06:59:39.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-21T06:59:39.902 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:40.017 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:40.015+0000 7fb4ef01e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-21T06:59:40.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:40.015+0000 7fb4ef01e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-21T06:59:40.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:40.016+0000 7fb4ef01e640 -1 bdev(0x5577287dd900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-21T06:59:40.018 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:40.016+0000 7fb4ef01e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-21T06:59:42.926 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T06:59:42.955 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:43.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:43.055+0000 7f03750fe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-21T06:59:43.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:43.056+0000 7f03750fe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-21T06:59:43.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:43.056+0000 7f03750fe640 -1 bdev(0x563922b45900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-21T06:59:43.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:43.056+0000 7f03750fe640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-21T06:59:45.960 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T06:59:45.987 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:46.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:46.083+0000 7f77a4420640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-21T06:59:46.085 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:46.084+0000 7f77a4420640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-21T06:59:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:46.084+0000 7f77a4420640 -1 bdev(0x55e307483900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-21T06:59:46.086 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:46.084+0000 7f77a4420640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-21T06:59:47.623 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:59:47.626 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T06:59:49.252 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T06:59:49.278 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:49.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:49.373+0000 7fd08b11b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-21T06:59:49.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:49.373+0000 7fd08b11b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-21T06:59:49.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:49.373+0000 7fd08b11b640 -1 bdev(0x55a051ced900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-21T06:59:49.375 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:49.373+0000 7fd08b11b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-21T06:59:53.018 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T06:59:53.046 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T06:59:53.046 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:53.046 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-21T06:59:53.077 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:53.077 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-21T06:59:53.147 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:53.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-21T06:59:53.216 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:53.216 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T06:59:53.284 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:53.284 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T06:59:53.352 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:53.352 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T06:59:53.419 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:53.419 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T06:59:53.485 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:53.486 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T06:59:53.515 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:53.515 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-21T06:59:53.584 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:53.585 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-21T06:59:53.652 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:53.652 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-21T06:59:53.719 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:53.719 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-21T06:59:53.786 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:53.786 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-21T06:59:53.852 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:53.852 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-21T06:59:53.918 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:53.918 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T06:59:53.935 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:53.935 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-21T06:59:53.993 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:53.993 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T06:59:54.009 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:54.009 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-21T06:59:54.064 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T06:59:54.065 DEBUG:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T06:59:54.067 DEBUG:teuthology.orchestra.run.smithi071:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T06:59:54.107 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.y] 2024-09-21T06:59:54.107 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDIbu5mR9WaCBAAQrOhRcZdJy77nbiwIIpNzA== 2024-09-21T06:59:54.107 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2024-09-21T06:59:54.107 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDIbu5meVd6ERAANGtaz6BkYKbchfRjvIjleQ== 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c] 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDIbu5mSHBNGRAA8Jn8O+btocLR/dYZhMObkA== 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDMbu5mcp3DCxAAkQ7/BGxbj9HZruEL18uXbQ== 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDPbu5m2sS9HhAAQLSNKB+L11umAFGRU2SdRg== 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDSbu5mxorjIRAAZpxUa3uAEL4tNaW6s6xbhw== 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.3] 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDVbu5mwH2yMxAAyQmVjMwkvW3wvke3oz1uvA== 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDIbu5mXZ6TDRAAW9ePEsTLEIIc5GKFurGB2A== 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDIbu5mAC26HhAAp2txhZwvIUr/+F6PI1X9qQ== 2024-09-21T06:59:54.108 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d] 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDIbu5mmLxTJhAAzruHU6YrbEHo9Rr27AanZA== 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.4] 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDcbu5m1RH6ABAA/y6ZIItVPI9n4HAbPGHuFw== 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.5] 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDfbu5mfs1fAxAAreQ3vZikJcCID2ZvVoOwOA== 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.6] 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDibu5mbaoLBRAAddJirSFHx4XxXSgc5SZvCg== 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.7] 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDlbu5m0B9NFhAABxA3thk/yIeLC9GVJik6Eg== 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDIbu5m2BwLKxAApPnoP3MWVo8VSu4x9i/uCg== 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout:[client.2] 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDIbu5mpc7oLhAAwoG0LEhpxmtQpA4+1CwCqA== 2024-09-21T06:59:54.109 INFO:teuthology.orchestra.run.smithi063.stdout:[client.1] 2024-09-21T06:59:54.110 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDIbu5moBCvMhAAggkJHqcJoA6e7GjiKD5atA== 2024-09-21T06:59:54.110 INFO:teuthology.orchestra.run.smithi063.stdout:[client.3] 2024-09-21T06:59:54.110 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDIbu5mKWNkNhAAIo/VPx0qINR34qhkIOPC9Q== 2024-09-21T06:59:54.127 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.y] 2024-09-21T06:59:54.127 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDIbu5mR9WaCBAAQrOhRcZdJy77nbiwIIpNzA== 2024-09-21T06:59:54.127 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.a] 2024-09-21T06:59:54.127 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDIbu5meVd6ERAANGtaz6BkYKbchfRjvIjleQ== 2024-09-21T06:59:54.127 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.c] 2024-09-21T06:59:54.127 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDIbu5mSHBNGRAA8Jn8O+btocLR/dYZhMObkA== 2024-09-21T06:59:54.127 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.0] 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDMbu5mcp3DCxAAkQ7/BGxbj9HZruEL18uXbQ== 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.1] 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDPbu5m2sS9HhAAQLSNKB+L11umAFGRU2SdRg== 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.2] 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDSbu5mxorjIRAAZpxUa3uAEL4tNaW6s6xbhw== 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.3] 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDVbu5mwH2yMxAAyQmVjMwkvW3wvke3oz1uvA== 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.x] 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDIbu5mXZ6TDRAAW9ePEsTLEIIc5GKFurGB2A== 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.b] 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDIbu5mAC26HhAAp2txhZwvIUr/+F6PI1X9qQ== 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout:[mds.d] 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDIbu5mmLxTJhAAzruHU6YrbEHo9Rr27AanZA== 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.4] 2024-09-21T06:59:54.128 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDcbu5m1RH6ABAA/y6ZIItVPI9n4HAbPGHuFw== 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.5] 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDfbu5mfs1fAxAAreQ3vZikJcCID2ZvVoOwOA== 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.6] 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDibu5mbaoLBRAAddJirSFHx4XxXSgc5SZvCg== 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.7] 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDlbu5m0B9NFhAABxA3thk/yIeLC9GVJik6Eg== 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDIbu5m2BwLKxAApPnoP3MWVo8VSu4x9i/uCg== 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout:[client.2] 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDIbu5mpc7oLhAAwoG0LEhpxmtQpA4+1CwCqA== 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout:[client.1] 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDIbu5moBCvMhAAggkJHqcJoA6e7GjiKD5atA== 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout:[client.3] 2024-09-21T06:59:54.129 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQDIbu5mKWNkNhAAIo/VPx0qINR34qhkIOPC9Q== 2024-09-21T06:59:54.130 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T06:59:54.153 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T06:59:54.231 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:59:54.233 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:59:54.298 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:59:54.301 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:59:54.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:54.367 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:54.428 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:54.430 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:54.491 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:54.493 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:54.554 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:54.556 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:54.617 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T06:59:54.620 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T06:59:54.680 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:59:54.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:59:54.747 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:59:54.749 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-21T06:59:54.813 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:54.815 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:54.876 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:54.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:54.939 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:54.942 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:55.003 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:55.005 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T06:59:55.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:59:55.071 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:59:55.135 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:59:55.137 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:59:55.201 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:59:55.204 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:59:55.268 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:59:55.270 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T06:59:55.335 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T06:59:55.335 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T06:59:55.360 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T06:59:55.468 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T06:59:55.493 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-21T06:59:55.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T06:59:55.625 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-21T06:59:55.649 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-21T06:59:55.714 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T06:59:55.820 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-21T06:59:55.844 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:55.846 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T06:59:55.899 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T06:59:55.899 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T06:59:55.900 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T06:59:55.903 INFO:tasks.ceph.mon.a:Started 2024-09-21T06:59:55.903 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T06:59:55.903 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T06:59:55.942 INFO:tasks.ceph.mon.b:Started 2024-09-21T06:59:55.942 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T06:59:55.942 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T06:59:55.944 INFO:tasks.ceph.mon.c:Started 2024-09-21T06:59:55.944 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T06:59:55.944 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-21T06:59:55.945 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-21T06:59:55.947 INFO:tasks.ceph.mgr.y:Started 2024-09-21T06:59:55.947 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T06:59:55.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T06:59:55.949 INFO:tasks.ceph.mgr.x:Started 2024-09-21T06:59:55.949 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-21T06:59:55.949 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-21T06:59:55.951 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-21T06:59:55.952 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-21T06:59:55.995 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-21T06:59:55.995 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-21T06:59:56.039 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-21T06:59:56.039 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-21T06:59:56.082 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-21T06:59:56.082 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-21T06:59:56.126 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-21T06:59:56.127 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-21T06:59:56.170 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-21T06:59:56.170 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-21T06:59:56.214 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-21T06:59:56.215 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-21T06:59:56.257 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-21T06:59:56.257 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-21T06:59:56.306 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-21T06:59:56.306 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-21T06:59:56.353 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-21T06:59:56.354 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-21T06:59:56.401 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-21T06:59:56.402 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-21T06:59:56.447 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-21T06:59:56.447 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-21T06:59:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.475+0000 7f1da29cf640 1 -- 172.21.15.63:0/2054757867 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d9c1f0590 msgr2=0x7f1d9c1502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.475+0000 7f1da29cf640 1 --2- 172.21.15.63:0/2054757867 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d9c1f0590 0x7f1d9c1502a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1d90003fa0 tx=0x7f1d9000ba20 comp rx=0 tx=0).stop 2024-09-21T06:59:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.476+0000 7f1da29cf640 1 -- 172.21.15.63:0/2054757867 shutdown_connections 2024-09-21T06:59:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.476+0000 7f1da29cf640 1 --2- 172.21.15.63:0/2054757867 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d9c1507e0 0x7f1d9c14bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.476+0000 7f1da29cf640 1 --2- 172.21.15.63:0/2054757867 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1d9c1f0590 0x7f1d9c1502a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.476+0000 7f1da29cf640 1 --2- 172.21.15.63:0/2054757867 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1d84004d20 0x7f1d9c14b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.476+0000 7f1da29cf640 1 -- 172.21.15.63:0/2054757867 >> 172.21.15.63:0/2054757867 conn(0x7f1d9c0cd510 msgr2=0x7f1d9c0ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.476+0000 7f1da29cf640 1 -- 172.21.15.63:0/2054757867 shutdown_connections 2024-09-21T06:59:56.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.476+0000 7f1da29cf640 1 -- 172.21.15.63:0/2054757867 wait complete. 2024-09-21T06:59:56.482 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T06:59:56.483 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-21T06:59:56.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.479+0000 7fdb993c2640 1 -- 172.21.15.63:0/87728800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c006510 msgr2=0x7fdb8c006920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.479+0000 7fdb993c2640 1 --2- 172.21.15.63:0/87728800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c006510 0x7fdb8c006920 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009830 tx=0x7fdb8402a540 comp rx=0 tx=0).stop 2024-09-21T06:59:56.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.494+0000 7fdb993c2640 1 -- 172.21.15.63:0/87728800 shutdown_connections 2024-09-21T06:59:56.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.494+0000 7fdb993c2640 1 --2- 172.21.15.63:0/87728800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c006510 0x7fdb8c006920 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.494+0000 7fdb993c2640 1 --2- 172.21.15.63:0/87728800 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdb8c0372d0 0x7fdb8c0df720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.494+0000 7fdb993c2640 1 -- 172.21.15.63:0/87728800 >> 172.21.15.63:0/87728800 conn(0x7fdb8c01e260 msgr2=0x7fdb8c039f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.497 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T06:59:56.498 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-21T06:59:56.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.496+0000 7fdb993c2640 1 -- 172.21.15.63:0/87728800 shutdown_connections 2024-09-21T06:59:56.504 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-21T06:59:56.505 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-21T06:59:56.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.505+0000 7fdb993c2640 1 -- 172.21.15.63:0/87728800 wait complete. 2024-09-21T06:59:56.513 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-21T06:59:56.513 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-21T06:59:56.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.510+0000 7fdb993c2640 1 Processor -- start 2024-09-21T06:59:56.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.510+0000 7fdb993c2640 1 -- start start 2024-09-21T06:59:56.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.516+0000 7fdb993c2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb8c006510 0x7fdb8c0dc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.521 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-21T06:59:56.521 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-21T06:59:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.517+0000 7fdb92ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb8c006510 0x7fdb8c0dc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.517+0000 7fdb92ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb8c006510 0x7fdb8c0dc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44496/0 (socket says 172.21.15.63:44496) 2024-09-21T06:59:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.517+0000 7fdb92ffd640 1 -- 172.21.15.63:0/836092122 learned_addr learned my addr 172.21.15.63:0/836092122 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.517+0000 7fdb993c2640 1 --2- 172.21.15.63:0/836092122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c007a50 0x7fdb8c04d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.517+0000 7fdb993c2640 1 --2- 172.21.15.63:0/836092122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdb8c0372d0 0x7fdb8c04daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.519+0000 7fdb993c2640 1 -- 172.21.15.63:0/836092122 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c053b70 con 0x7fdb8c006510 2024-09-21T06:59:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.519+0000 7fdb993c2640 1 -- 172.21.15.63:0/836092122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c0539f0 con 0x7fdb8c007a50 2024-09-21T06:59:56.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.519+0000 7fdb993c2640 1 -- 172.21.15.63:0/836092122 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fdb8c053cf0 con 0x7fdb8c0372d0 2024-09-21T06:59:56.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.519+0000 7fdb937fe640 1 --2- 172.21.15.63:0/836092122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdb8c0372d0 0x7fdb8c04daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.520+0000 7fdb92ffd640 1 -- 172.21.15.63:0/836092122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdb8c0372d0 msgr2=0x7fdb8c04daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.520+0000 7fdb92ffd640 1 --2- 172.21.15.63:0/836092122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdb8c0372d0 0x7fdb8c04daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.520+0000 7fdb92ffd640 1 -- 172.21.15.63:0/836092122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c007a50 msgr2=0x7fdb8c04d560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:59:56.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.520+0000 7fdb92ffd640 1 --2- 172.21.15.63:0/836092122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c007a50 0x7fdb8c04d560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.520+0000 7fdb92ffd640 1 -- 172.21.15.63:0/836092122 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8c049e70 con 0x7fdb8c006510 2024-09-21T06:59:56.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.520+0000 7fdb92ffd640 1 --2- 172.21.15.63:0/836092122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb8c006510 0x7fdb8c0dc4f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb9406c290 tx=0x7fdb9406a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:56.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.521+0000 7fdb937fe640 1 --2- 172.21.15.63:0/836092122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdb8c0372d0 0x7fdb8c04daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:59:56.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.521+0000 7fdb7b7fe640 1 -- 172.21.15.63:0/836092122 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94098070 con 0x7fdb8c006510 2024-09-21T06:59:56.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.521+0000 7fdb7b7fe640 1 -- 172.21.15.63:0/836092122 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fdb94072d20 con 0x7fdb8c006510 2024-09-21T06:59:56.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.521+0000 7fdb7b7fe640 1 -- 172.21.15.63:0/836092122 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94093630 con 0x7fdb8c006510 2024-09-21T06:59:56.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.521+0000 7fdb993c2640 1 -- 172.21.15.63:0/836092122 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8c04a150 con 0x7fdb8c006510 2024-09-21T06:59:56.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.521+0000 7fdb7b7fe640 1 -- 172.21.15.63:0/836092122 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdb940937d0 con 0x7fdb8c006510 2024-09-21T06:59:56.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.522+0000 7fdb993c2640 1 -- 172.21.15.63:0/836092122 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb8c04a710 con 0x7fdb8c006510 2024-09-21T06:59:56.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.522+0000 7fdb7b7fe640 1 -- 172.21.15.63:0/836092122 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdb9409b360 con 0x7fdb8c006510 2024-09-21T06:59:56.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.524+0000 7fdb797fa640 1 -- 172.21.15.63:0/836092122 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb6c005290 con 0x7fdb8c006510 2024-09-21T06:59:56.538 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-21T06:59:56.539 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-21T06:59:56.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.532+0000 7f5bdf57b640 1 -- 172.21.15.63:0/1285243727 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f5bb0005310 con 0x7f5bd80b3d30 2024-09-21T06:59:56.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.529+0000 7fdb7b7fe640 1 -- 172.21.15.63:0/836092122 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdb940a1070 con 0x7fdb8c006510 2024-09-21T06:59:56.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.540+0000 7f5bcdffb640 1 -- 172.21.15.63:0/1285243727 <== mon.1 v2:172.21.15.71:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bc801ad30 con 0x7f5bd80b3d30 2024-09-21T06:59:56.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.540+0000 7f5bcdffb640 1 -- 172.21.15.63:0/1285243727 <== mon.1 v2:172.21.15.71:3300/0 12 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f5bc8005020 con 0x7f5bd80b3d30 2024-09-21T06:59:56.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.541+0000 7f62a0ff9640 1 -- 172.21.15.63:0/3677423452 <== mon.0 v2:172.21.15.63:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f629800ac80 con 0x7f629c02b490 2024-09-21T06:59:56.546 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T06:59:56.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T06:59:56.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.541+0000 7faad37fe640 1 -- 172.21.15.63:0/1369092658 <== mon.2 v2:172.21.15.71:3301/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faae0024430 con 0x7faaec142510 2024-09-21T06:59:56.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.543+0000 7fdb7b7fe640 1 -- 172.21.15.63:0/836092122 <== mon.0 v2:172.21.15.63:3300/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb94093ac0 con 0x7fdb8c006510 2024-09-21T06:59:56.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.544+0000 7f5bc37fe640 1 -- 172.21.15.63:0/1285243727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bd80b3d30 msgr2=0x7f5bd8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.544+0000 7f5bc37fe640 1 --2- 172.21.15.63:0/1285243727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bd80b3d30 0x7f5bd8071180 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5bc8005f10 tx=0x7f5bc8010e50 comp rx=0 tx=0).stop 2024-09-21T06:59:56.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.545+0000 7f5bc37fe640 1 -- 172.21.15.63:0/1285243727 shutdown_connections 2024-09-21T06:59:56.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.545+0000 7f5bc37fe640 1 --2- 172.21.15.63:0/1285243727 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5bd80b4350 0x7f5bd80716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.545+0000 7f5bc37fe640 1 --2- 172.21.15.63:0/1285243727 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bd80b3d30 0x7f5bd8071180 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.545+0000 7f5bc37fe640 1 --2- 172.21.15.63:0/1285243727 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5bd80b3920 0x7f5bd815af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.545+0000 7f5bc37fe640 1 -- 172.21.15.63:0/1285243727 >> 172.21.15.63:0/1285243727 conn(0x7f5bd809aa40 msgr2=0x7f5bd8153c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.550 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-21T06:59:56.551 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-21T06:59:56.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.545+0000 7f5bc37fe640 1 -- 172.21.15.63:0/1285243727 shutdown_connections 2024-09-21T06:59:56.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.548+0000 7f5bc37fe640 1 -- 172.21.15.63:0/1285243727 wait complete. 2024-09-21T06:59:56.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.586+0000 7ff7c5362640 1 -- 172.21.15.63:0/1196375792 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0037a0 msgr2=0x7ff7ac003c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.586+0000 7ff7c5362640 1 --2- 172.21.15.63:0/1196375792 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7ac0037a0 0x7ff7ac003c10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff7c006fbf0 tx=0x7ff7ac005830 comp rx=0 tx=0).stop 2024-09-21T06:59:56.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.586+0000 7ff7bf7fe640 1 -- 172.21.15.63:0/1196375792 reap_dead start 2024-09-21T06:59:56.592 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-21T06:59:56.592 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-21T06:59:56.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.586+0000 7ff7c5362640 1 -- 172.21.15.63:0/1196375792 shutdown_connections 2024-09-21T06:59:56.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.586+0000 7ff7c5362640 1 -- 172.21.15.63:0/1196375792 >> 172.21.15.63:0/1196375792 conn(0x7ff7c00cd510 msgr2=0x7ff7c00cd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.590+0000 7ff7c5362640 1 -- 172.21.15.63:0/1196375792 shutdown_connections 2024-09-21T06:59:56.600 DEBUG:tasks.ceph:set 22 configs 2024-09-21T06:59:56.600 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi063') 2024-09-21T06:59:56.601 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi063') 2024-09-21T06:59:56.601 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi063') 2024-09-21T06:59:56.601 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi063') 2024-09-21T06:59:56.602 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi063') 2024-09-21T06:59:56.602 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi063') 2024-09-21T06:59:56.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.591+0000 7ff7c5362640 1 -- 172.21.15.63:0/1196375792 wait complete. 2024-09-21T06:59:56.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.594+0000 7ff7c5362640 1 Processor -- start 2024-09-21T06:59:56.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.595+0000 7ff7c5362640 1 -- start start 2024-09-21T06:59:56.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.597+0000 7ff7c5362640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7c01fda60 0x7ff7c0158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.608+0000 7ff7c5362640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7c01433e0 0x7ff7c01fce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.608+0000 7ff7c5362640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7c01437f0 0x7ff7c01fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.608+0000 7ff7c5362640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c00cc8d0 con 0x7ff7c01fda60 2024-09-21T06:59:56.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.608+0000 7ff7c5362640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c00cc750 con 0x7ff7c01437f0 2024-09-21T06:59:56.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.608+0000 7ff7c5362640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c00cca50 con 0x7ff7c01433e0 2024-09-21T06:59:56.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.608+0000 7ff7beffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7c01fda60 0x7ff7c0158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.608+0000 7ff7beffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7c01fda60 0x7ff7c0158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44518/0 (socket says 172.21.15.63:44518) 2024-09-21T06:59:56.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.608+0000 7ff7beffd640 1 -- 172.21.15.63:0/433842269 learned_addr learned my addr 172.21.15.63:0/433842269 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:56.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.609+0000 7ff7beffd640 1 -- 172.21.15.63:0/433842269 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7c01433e0 msgr2=0x7ff7c01fce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.609+0000 7ff7beffd640 1 --2- 172.21.15.63:0/433842269 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7c01433e0 0x7ff7c01fce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.609+0000 7ff7beffd640 1 -- 172.21.15.63:0/433842269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7c01437f0 msgr2=0x7ff7c01fd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.609+0000 7ff7beffd640 1 --2- 172.21.15.63:0/433842269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7c01437f0 0x7ff7c01fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.609+0000 7ff7beffd640 1 -- 172.21.15.63:0/433842269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c0159080 con 0x7ff7c01fda60 2024-09-21T06:59:56.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.610+0000 7ff7beffd640 1 --2- 172.21.15.63:0/433842269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7c01fda60 0x7ff7c0158850 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000fb70 tx=0x7ff7b000b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:56.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.613+0000 7ff7b77fe640 1 -- 172.21.15.63:0/433842269 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0004230 con 0x7ff7c01fda60 2024-09-21T06:59:56.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.613+0000 7ff7b77fe640 1 -- 172.21.15.63:0/433842269 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7b00043d0 con 0x7ff7c01fda60 2024-09-21T06:59:56.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.614+0000 7ff7b77fe640 1 -- 172.21.15.63:0/433842269 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0003850 con 0x7ff7c01fda60 2024-09-21T06:59:56.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.615+0000 7ff7c5362640 1 -- 172.21.15.63:0/433842269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c0159360 con 0x7ff7c01fda60 2024-09-21T06:59:56.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.615+0000 7ff7c5362640 1 -- 172.21.15.63:0/433842269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c0159920 con 0x7ff7c01fda60 2024-09-21T06:59:56.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.616+0000 7ff7c5362640 1 -- 172.21.15.63:0/433842269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c0051080 con 0x7ff7c01fda60 2024-09-21T06:59:56.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.618+0000 7faad17fa640 1 -- 172.21.15.63:0/1369092658 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7faac40052f0 con 0x7faaec142510 2024-09-21T06:59:56.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.624+0000 7ff7b77fe640 1 -- 172.21.15.63:0/433842269 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff7b00039f0 con 0x7ff7c01fda60 2024-09-21T06:59:56.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.624+0000 7ff7b77fe640 1 -- 172.21.15.63:0/433842269 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff7b0018780 con 0x7ff7c01fda60 2024-09-21T06:59:56.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.624+0000 7ff7b77fe640 1 -- 172.21.15.63:0/433842269 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff7c0051080 con 0x7ff7c01fda60 2024-09-21T06:59:56.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.634+0000 7faad37fe640 1 -- 172.21.15.63:0/1369092658 <== mon.2 v2:172.21.15.71:3301/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7faae00248c0 con 0x7faaec142510 2024-09-21T06:59:56.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.636+0000 7faaf1332640 1 -- 172.21.15.63:0/1369092658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaec142510 msgr2=0x7faaec13a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.636+0000 7faaf1332640 1 --2- 172.21.15.63:0/1369092658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaec142510 0x7faaec13a480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faae0006fc0 tx=0x7faae000c6f0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.636+0000 7faaf1332640 1 -- 172.21.15.63:0/1369092658 shutdown_connections 2024-09-21T06:59:56.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.636+0000 7faaf1332640 1 --2- 172.21.15.63:0/1369092658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7faaec142510 0x7faaec13a480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.636+0000 7faaf1332640 1 --2- 172.21.15.63:0/1369092658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faaec0cb0e0 0x7faaec139f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.636+0000 7faaf1332640 1 --2- 172.21.15.63:0/1369092658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faaec071d10 0x7faaec0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.636+0000 7faaf1332640 1 -- 172.21.15.63:0/1369092658 >> 172.21.15.63:0/1369092658 conn(0x7faaec0cd510 msgr2=0x7faaec06f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.639+0000 7faaf1332640 1 -- 172.21.15.63:0/1369092658 shutdown_connections 2024-09-21T06:59:56.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.639+0000 7faaf1332640 1 -- 172.21.15.63:0/1369092658 wait complete. 2024-09-21T06:59:56.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.645+0000 7fc2897c3640 1 -- 172.21.15.63:0/4203782375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc27c0063a0 msgr2=0x7fc27c051310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.645+0000 7fc2897c3640 1 --2- 172.21.15.63:0/4203782375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc27c0063a0 0x7fc27c051310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc28406af70 tx=0x7fc2840a65c0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.646+0000 7fc2897c3640 1 -- 172.21.15.63:0/4203782375 shutdown_connections 2024-09-21T06:59:56.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.646+0000 7fc2897c3640 1 --2- 172.21.15.63:0/4203782375 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc27c0063a0 0x7fc27c051310 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.646+0000 7fc2897c3640 1 --2- 172.21.15.63:0/4203782375 >> v2:172.21.15.71:3300/0 conn(0x7fc27c0e7200 0x7fc27c005e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.646+0000 7fc2897c3640 1 -- 172.21.15.63:0/4203782375 >> 172.21.15.63:0/4203782375 conn(0x7fc27c01d9d0 msgr2=0x7fc27c039690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.650+0000 7fc2897c3640 1 -- 172.21.15.63:0/4203782375 shutdown_connections 2024-09-21T06:59:56.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.650+0000 7fc2897c3640 1 -- 172.21.15.63:0/4203782375 wait complete. 2024-09-21T06:59:56.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.653+0000 7fc2897c3640 1 Processor -- start 2024-09-21T06:59:56.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.653+0000 7fc2897c3640 1 -- start start 2024-09-21T06:59:56.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.655+0000 7fc2897c3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc27c052390 0x7fc27c181be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.656+0000 7fc2897c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0e7200 0x7fc27c032720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.656+0000 7fc2897c3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc27c182120 0x7fc27c032c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.656+0000 7fc2897c3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c033ea0 con 0x7fc27c052390 2024-09-21T06:59:56.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.656+0000 7fc2897c3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c0e3650 con 0x7fc27c0e7200 2024-09-21T06:59:56.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.656+0000 7fc2897c3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc27c0067b0 con 0x7fc27c182120 2024-09-21T06:59:56.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.656+0000 7fc282ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc27c052390 0x7fc27c181be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.656+0000 7fc282ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc27c052390 0x7fc27c181be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44550/0 (socket says 172.21.15.63:44550) 2024-09-21T06:59:56.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.656+0000 7fc282ffd640 1 -- 172.21.15.63:0/3410243662 learned_addr learned my addr 172.21.15.63:0/3410243662 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:56.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.656+0000 7fc282ffd640 1 -- 172.21.15.63:0/3410243662 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc27c182120 msgr2=0x7fc27c032c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T06:59:56.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.656+0000 7fc282ffd640 1 --2- 172.21.15.63:0/3410243662 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc27c182120 0x7fc27c032c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.656+0000 7fc282ffd640 1 -- 172.21.15.63:0/3410243662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0e7200 msgr2=0x7fc27c032720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T06:59:56.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.656+0000 7fc282ffd640 1 --2- 172.21.15.63:0/3410243662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0e7200 0x7fc27c032720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.656+0000 7fc282ffd640 1 -- 172.21.15.63:0/3410243662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27c048400 con 0x7fc27c052390 2024-09-21T06:59:56.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.657+0000 7fc282ffd640 1 --2- 172.21.15.63:0/3410243662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc27c052390 0x7fc27c181be0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc27800c4e0 tx=0x7fc27800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:56.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.671+0000 7fc26b7fe640 1 -- 172.21.15.63:0/3410243662 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278016020 con 0x7fc27c052390 2024-09-21T06:59:56.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.671+0000 7fc2897c3640 1 -- 172.21.15.63:0/3410243662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27c0486e0 con 0x7fc27c052390 2024-09-21T06:59:56.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.671+0000 7fc2897c3640 1 -- 172.21.15.63:0/3410243662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc27c048ca0 con 0x7fc27c052390 2024-09-21T06:59:56.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.673+0000 7fc26b7fe640 1 -- 172.21.15.63:0/3410243662 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc278012920 con 0x7fc27c052390 2024-09-21T06:59:56.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.673+0000 7fc26b7fe640 1 -- 172.21.15.63:0/3410243662 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278012d70 con 0x7fc27c052390 2024-09-21T06:59:56.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.674+0000 7fc26b7fe640 1 -- 172.21.15.63:0/3410243662 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc278019020 con 0x7fc27c052390 2024-09-21T06:59:56.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.674+0000 7fc26b7fe640 1 -- 172.21.15.63:0/3410243662 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc27801a920 con 0x7fc27c052390 2024-09-21T06:59:56.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.675+0000 7fc2697fa640 1 -- 172.21.15.63:0/3410243662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc264005290 con 0x7fc27c052390 2024-09-21T06:59:56.680 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi063') 2024-09-21T06:59:56.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.681+0000 7fc26b7fe640 1 -- 172.21.15.63:0/3410243662 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc278020030 con 0x7fc27c052390 2024-09-21T06:59:56.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.718+0000 7f96fa30b640 1 -- 172.21.15.63:0/1701925567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96dc003b30 msgr2=0x7f96dc003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.718+0000 7f96fa30b640 1 --2- 172.21.15.63:0/1701925567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96dc003b30 0x7f96dc003fa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009bf0 tx=0x7f96dc005830 comp rx=0 tx=0).stop 2024-09-21T06:59:56.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.718+0000 7f96f88a8640 1 -- 172.21.15.63:0/1701925567 reap_dead start 2024-09-21T06:59:56.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.722+0000 7f96fa30b640 1 -- 172.21.15.63:0/1701925567 shutdown_connections 2024-09-21T06:59:56.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.722+0000 7f96fa30b640 1 -- 172.21.15.63:0/1701925567 >> 172.21.15.63:0/1701925567 conn(0x7f96f40b1d50 msgr2=0x7f96f40b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.724+0000 7f96fa30b640 1 -- 172.21.15.63:0/1701925567 shutdown_connections 2024-09-21T06:59:56.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.728+0000 7f96fa30b640 1 -- 172.21.15.63:0/1701925567 wait complete. 2024-09-21T06:59:56.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.731+0000 7f96fa30b640 1 Processor -- start 2024-09-21T06:59:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.731+0000 7f96fa30b640 1 -- start start 2024-09-21T06:59:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.733+0000 7f96fa30b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96dc003b30 0x7f96f420af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.733+0000 7f96fa30b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96f4096d90 0x7f96f420b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.733+0000 7f96fa30b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96f40c8470 0x7f96f40c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.733+0000 7f96fa30b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f96f40b2c00 con 0x7f96f40c8470 2024-09-21T06:59:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.733+0000 7f96fa30b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f96f40b2a80 con 0x7f96dc003b30 2024-09-21T06:59:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.733+0000 7f96fa30b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f96f40cb4a0 con 0x7f96f4096d90 2024-09-21T06:59:56.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.734+0000 7f96f88a8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96f40c8470 0x7f96f40c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.734+0000 7f96f88a8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96f40c8470 0x7f96f40c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44574/0 (socket says 172.21.15.63:44574) 2024-09-21T06:59:56.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.734+0000 7f96f88a8640 1 -- 172.21.15.63:0/3038960574 learned_addr learned my addr 172.21.15.63:0/3038960574 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:56.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.735+0000 7f96f37fe640 1 --2- 172.21.15.63:0/3038960574 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96f4096d90 0x7f96f420b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.735+0000 7f96f3fff640 1 --2- 172.21.15.63:0/3038960574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96dc003b30 0x7f96f420af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.735+0000 7f96f88a8640 1 -- 172.21.15.63:0/3038960574 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96f4096d90 msgr2=0x7f96f420b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.735+0000 7f96f88a8640 1 --2- 172.21.15.63:0/3038960574 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96f4096d90 0x7f96f420b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.735+0000 7f96f88a8640 1 -- 172.21.15.63:0/3038960574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96dc003b30 msgr2=0x7f96f420af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.735+0000 7f96f88a8640 1 --2- 172.21.15.63:0/3038960574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96dc003b30 0x7f96f420af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.735+0000 7f96f88a8640 1 -- 172.21.15.63:0/3038960574 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f40c93e0 con 0x7f96f40c8470 2024-09-21T06:59:56.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.736+0000 7f96f88a8640 1 --2- 172.21.15.63:0/3038960574 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96f40c8470 0x7f96f40c8880 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f96ec005fd0 tx=0x7f96ec007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:56.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.736+0000 7f96f0ff9640 1 -- 172.21.15.63:0/3038960574 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec004b20 con 0x7f96f40c8470 2024-09-21T06:59:56.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.736+0000 7f96fa30b640 1 -- 172.21.15.63:0/3038960574 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f40c96c0 con 0x7f96f40c8470 2024-09-21T06:59:56.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.736+0000 7f96fa30b640 1 -- 172.21.15.63:0/3038960574 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f420c220 con 0x7f96f40c8470 2024-09-21T06:59:56.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.737+0000 7f96f0ff9640 1 -- 172.21.15.63:0/3038960574 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96ec004cc0 con 0x7f96f40c8470 2024-09-21T06:59:56.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.737+0000 7f96f0ff9640 1 -- 172.21.15.63:0/3038960574 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ec003bd0 con 0x7f96f40c8470 2024-09-21T06:59:56.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.737+0000 7f96f0ff9640 1 -- 172.21.15.63:0/3038960574 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f96ec01c030 con 0x7f96f40c8470 2024-09-21T06:59:56.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.737+0000 7f96f0ff9640 1 -- 172.21.15.63:0/3038960574 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f96ec015470 con 0x7f96f40c8470 2024-09-21T06:59:56.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.739+0000 7f96fa30b640 1 -- 172.21.15.63:0/3038960574 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d4005290 con 0x7f96f40c8470 2024-09-21T06:59:56.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.749+0000 7f96f0ff9640 1 -- 172.21.15.63:0/3038960574 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f96ec023020 con 0x7f96f40c8470 2024-09-21T06:59:56.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.795+0000 7fdb797fa640 1 -- 172.21.15.63:0/836092122 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fdb6c005850 con 0x7fdb8c006510 2024-09-21T06:59:56.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.796+0000 7f62a9727640 1 -- 172.21.15.63:0/3677423452 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f6284001690 con 0x7f629c02b490 2024-09-21T06:59:56.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.803+0000 7fdb7b7fe640 1 -- 172.21.15.63:0/836092122 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v8)=0 v8) ==== 106+0+0 (secure 0 0 0) 0x7fdb94093c70 con 0x7fdb8c006510 2024-09-21T06:59:56.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.805+0000 7fdb993c2640 1 -- 172.21.15.63:0/836092122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb8c006510 msgr2=0x7fdb8c0dc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.805+0000 7fdb993c2640 1 --2- 172.21.15.63:0/836092122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb8c006510 0x7fdb8c0dc4f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdb9406c290 tx=0x7fdb9406a1a0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.806+0000 7fdb993c2640 1 -- 172.21.15.63:0/836092122 shutdown_connections 2024-09-21T06:59:56.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.806+0000 7fdb993c2640 1 --2- 172.21.15.63:0/836092122 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdb8c0372d0 0x7fdb8c04daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.806+0000 7fdb993c2640 1 --2- 172.21.15.63:0/836092122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb8c007a50 0x7fdb8c04d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.806+0000 7fdb993c2640 1 --2- 172.21.15.63:0/836092122 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb8c006510 0x7fdb8c0dc4f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.806+0000 7fdb993c2640 1 -- 172.21.15.63:0/836092122 >> 172.21.15.63:0/836092122 conn(0x7fdb8c01e260 msgr2=0x7fdb8c0d7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.807+0000 7fdb993c2640 1 -- 172.21.15.63:0/836092122 shutdown_connections 2024-09-21T06:59:56.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.807+0000 7fdb993c2640 1 -- 172.21.15.63:0/836092122 wait complete. 2024-09-21T06:59:56.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.808+0000 7f62a0ff9640 1 -- 172.21.15.63:0/3677423452 <== mon.0 v2:172.21.15.63:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v9)=0 v9) ==== 117+0+0 (secure 0 0 0) 0x7f6298025480 con 0x7f629c02b490 2024-09-21T06:59:56.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.810+0000 7f628e7fc640 1 -- 172.21.15.63:0/3677423452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f629c02b490 msgr2=0x7f629c176370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.810+0000 7f628e7fc640 1 --2- 172.21.15.63:0/3677423452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f629c02b490 0x7f629c176370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f629800c8b0 tx=0x7f629800cd70 comp rx=0 tx=0).stop 2024-09-21T06:59:56.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.811+0000 7f628e7fc640 1 -- 172.21.15.63:0/3677423452 shutdown_connections 2024-09-21T06:59:56.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.811+0000 7f628e7fc640 1 --2- 172.21.15.63:0/3677423452 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f629c0530d0 0x7f629c178ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.811+0000 7f628e7fc640 1 --2- 172.21.15.63:0/3677423452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f629c021e20 0x7f629c052b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.811+0000 7f628e7fc640 1 --2- 172.21.15.63:0/3677423452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f629c02b490 0x7f629c176370 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.811+0000 7f628e7fc640 1 -- 172.21.15.63:0/3677423452 >> 172.21.15.63:0/3677423452 conn(0x7f629c051420 msgr2=0x7f629c038410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.811+0000 7f628e7fc640 1 -- 172.21.15.63:0/3677423452 shutdown_connections 2024-09-21T06:59:56.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.811+0000 7f628e7fc640 1 -- 172.21.15.63:0/3677423452 wait complete. 2024-09-21T06:59:56.867 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi063') 2024-09-21T06:59:56.868 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi063') 2024-09-21T06:59:56.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.869+0000 7fb09d63f640 1 -- 172.21.15.63:0/2655408544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb098160320 msgr2=0x7fb098161d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.872 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.869+0000 7fb09d63f640 1 --2- 172.21.15.63:0/2655408544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb098160320 0x7fb098161d20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb098072db0 tx=0x7fb08802a580 comp rx=0 tx=0).stop 2024-09-21T06:59:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.873+0000 7fb09d63f640 1 -- 172.21.15.63:0/2655408544 shutdown_connections 2024-09-21T06:59:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.873+0000 7fb09d63f640 1 --2- 172.21.15.63:0/2655408544 >> v2:172.21.15.71:3300/0 conn(0x7fb0980cca60 0x7fb0980cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.873+0000 7fb09d63f640 1 --2- 172.21.15.63:0/2655408544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb098160320 0x7fb098161d20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.873+0000 7fb09d63f640 1 -- 172.21.15.63:0/2655408544 >> 172.21.15.63:0/2655408544 conn(0x7fb0980b1cc0 msgr2=0x7fb0980b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.873+0000 7fb09d63f640 1 -- 172.21.15.63:0/2655408544 shutdown_connections 2024-09-21T06:59:56.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.873+0000 7fb09d63f640 1 -- 172.21.15.63:0/2655408544 wait complete. 2024-09-21T06:59:56.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.877+0000 7fb09d63f640 1 Processor -- start 2024-09-21T06:59:56.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.877+0000 7fb09d63f640 1 -- start start 2024-09-21T06:59:56.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.889+0000 7fb09d63f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb0980b4500 0x7fb0980cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.889+0000 7fb09d63f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0980cca60 0x7fb09814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.889+0000 7fb09d63f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb098160320 0x7fb098155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.890+0000 7fb096ffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb0980b4500 0x7fb0980cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.890+0000 7fb096ffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb0980b4500 0x7fb0980cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:56412/0 (socket says 172.21.15.63:56412) 2024-09-21T06:59:56.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.890+0000 7fb0977fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb098160320 0x7fb098155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.890+0000 7fb0977fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb098160320 0x7fb098155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44602/0 (socket says 172.21.15.63:44602) 2024-09-21T06:59:56.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.890+0000 7fb096ffd640 1 -- 172.21.15.63:0/2537784725 learned_addr learned my addr 172.21.15.63:0/2537784725 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:56.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.890+0000 7fb09d63f640 1 -- 172.21.15.63:0/2537784725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb09806f8d0 con 0x7fb098160320 2024-09-21T06:59:56.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.890+0000 7fb09d63f640 1 -- 172.21.15.63:0/2537784725 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb09806f750 con 0x7fb0980cca60 2024-09-21T06:59:56.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.891+0000 7fb09d63f640 1 -- 172.21.15.63:0/2537784725 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb09806fa50 con 0x7fb0980b4500 2024-09-21T06:59:56.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.891+0000 7fb0977fe640 1 -- 172.21.15.63:0/2537784725 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb0980b4500 msgr2=0x7fb0980cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.891+0000 7fb0977fe640 1 --2- 172.21.15.63:0/2537784725 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb0980b4500 0x7fb0980cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.891+0000 7fb0977fe640 1 -- 172.21.15.63:0/2537784725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0980cca60 msgr2=0x7fb09814fef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T06:59:56.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.891+0000 7fb0977fe640 1 --2- 172.21.15.63:0/2537784725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0980cca60 0x7fb09814fef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.891+0000 7fb0977fe640 1 -- 172.21.15.63:0/2537784725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb098150a10 con 0x7fb098160320 2024-09-21T06:59:56.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.892+0000 7f39ca884640 1 -- 172.21.15.63:0/1205916090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39c40b4c10 msgr2=0x7f39c40cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.892+0000 7f39ca884640 1 --2- 172.21.15.63:0/1205916090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39c40b4c10 0x7f39c40cf950 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f39b8007350 tx=0x7f39b802afd0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.892+0000 7f39ca884640 1 -- 172.21.15.63:0/1205916090 shutdown_connections 2024-09-21T06:59:56.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.892+0000 7f39ca884640 1 --2- 172.21.15.63:0/1205916090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39c40b4c10 0x7f39c40cf950 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.892+0000 7f39ca884640 1 -- 172.21.15.63:0/1205916090 >> 172.21.15.63:0/1205916090 conn(0x7f39c40b1cc0 msgr2=0x7f39c40b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.892+0000 7fb0977fe640 1 --2- 172.21.15.63:0/2537784725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb098160320 0x7fb098155620 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb090005fd0 tx=0x7fb09000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:56.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.893+0000 7f39ca884640 1 -- 172.21.15.63:0/1205916090 shutdown_connections 2024-09-21T06:59:56.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.893+0000 7fb07f7fe640 1 -- 172.21.15.63:0/2537784725 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09000ce70 con 0x7fb098160320 2024-09-21T06:59:56.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.893+0000 7f39ca884640 1 -- 172.21.15.63:0/1205916090 wait complete. 2024-09-21T06:59:56.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.896+0000 7fb07f7fe640 1 -- 172.21.15.63:0/2537784725 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb090004b20 con 0x7fb098160320 2024-09-21T06:59:56.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.896+0000 7fb09d63f640 1 -- 172.21.15.63:0/2537784725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb098150770 con 0x7fb098160320 2024-09-21T06:59:56.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.897+0000 7fb09d63f640 1 -- 172.21.15.63:0/2537784725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb098154e00 con 0x7fb098160320 2024-09-21T06:59:56.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.897+0000 7fb07f7fe640 1 -- 172.21.15.63:0/2537784725 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090005020 con 0x7fb098160320 2024-09-21T06:59:56.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.900+0000 7fb07f7fe640 1 -- 172.21.15.63:0/2537784725 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb090005590 con 0x7fb098160320 2024-09-21T06:59:56.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.900+0000 7fb07f7fe640 1 -- 172.21.15.63:0/2537784725 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb0900107d0 con 0x7fb098160320 2024-09-21T06:59:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.896+0000 7f39ca884640 1 Processor -- start 2024-09-21T06:59:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.898+0000 7f39ca884640 1 -- start start 2024-09-21T06:59:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.900+0000 7f39ca884640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39c4074c00 0x7f39c41eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.900+0000 7f39ca884640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39c408b4a0 0x7f39c409d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.900+0000 7f39ca884640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39c40b4c10 0x7f39c41f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.900+0000 7f39ca884640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f39c4073a50 con 0x7f39c40b4c10 2024-09-21T06:59:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.900+0000 7f39ca884640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f39c40738d0 con 0x7f39c4074c00 2024-09-21T06:59:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.900+0000 7f39ca884640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f39c4073bd0 con 0x7f39c408b4a0 2024-09-21T06:59:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.900+0000 7f39c37fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39c408b4a0 0x7f39c409d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.900+0000 7f39c37fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39c408b4a0 0x7f39c409d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:56422/0 (socket says 172.21.15.63:56422) 2024-09-21T06:59:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.900+0000 7f39c37fe640 1 -- 172.21.15.63:0/3486614517 learned_addr learned my addr 172.21.15.63:0/3486614517 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:56.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.900+0000 7f39c3fff640 1 --2- 172.21.15.63:0/3486614517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39c4074c00 0x7f39c41eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.900+0000 7f39c8e21640 1 --2- 172.21.15.63:0/3486614517 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39c40b4c10 0x7f39c41f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.901+0000 7f39c37fe640 1 -- 172.21.15.63:0/3486614517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39c4074c00 msgr2=0x7f39c41eda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.901+0000 7f39c37fe640 1 --2- 172.21.15.63:0/3486614517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39c4074c00 0x7f39c41eda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.901+0000 7f39c37fe640 1 -- 172.21.15.63:0/3486614517 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39c40b4c10 msgr2=0x7f39c41f1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.902+0000 7f39c37fe640 1 --2- 172.21.15.63:0/3486614517 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39c40b4c10 0x7f39c41f1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.902+0000 7f39c37fe640 1 -- 172.21.15.63:0/3486614517 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c409c600 con 0x7f39c408b4a0 2024-09-21T06:59:56.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.902+0000 7f39c8e21640 1 --2- 172.21.15.63:0/3486614517 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39c40b4c10 0x7f39c41f1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:59:56.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.902+0000 7f39c37fe640 1 --2- 172.21.15.63:0/3486614517 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39c408b4a0 0x7f39c409d6a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00cc80 tx=0x7f39bc00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:56.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.902+0000 7f39c0ff9640 1 -- 172.21.15.63:0/3486614517 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc016020 con 0x7f39c408b4a0 2024-09-21T06:59:56.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.903+0000 7f39ca884640 1 -- 172.21.15.63:0/3486614517 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c409c8e0 con 0x7f39c408b4a0 2024-09-21T06:59:56.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.903+0000 7f39ca884640 1 -- 172.21.15.63:0/3486614517 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c409cea0 con 0x7f39c408b4a0 2024-09-21T06:59:56.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.904+0000 7f39c0ff9640 1 -- 172.21.15.63:0/3486614517 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39bc012420 con 0x7f39c408b4a0 2024-09-21T06:59:56.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.904+0000 7f39c0ff9640 1 -- 172.21.15.63:0/3486614517 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc012850 con 0x7f39c408b4a0 2024-09-21T06:59:56.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.906+0000 7f39c0ff9640 1 -- 172.21.15.63:0/3486614517 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f39bc019020 con 0x7f39c408b4a0 2024-09-21T06:59:56.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.906+0000 7fb07d7fa640 1 -- 172.21.15.63:0/2537784725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb098069b70 con 0x7fb098160320 2024-09-21T06:59:56.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.910+0000 7fb07f7fe640 1 -- 172.21.15.63:0/2537784725 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb090005880 con 0x7fb098160320 2024-09-21T06:59:56.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.924+0000 7f39c0ff9640 1 -- 172.21.15.63:0/3486614517 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f39bc01a440 con 0x7f39c408b4a0 2024-09-21T06:59:56.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.924+0000 7f39ca884640 1 -- 172.21.15.63:0/3486614517 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a4005290 con 0x7f39c408b4a0 2024-09-21T06:59:56.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.927+0000 7f39c0ff9640 1 -- 172.21.15.63:0/3486614517 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f39bc020030 con 0x7f39c408b4a0 2024-09-21T06:59:56.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.931+0000 7f4fc852b640 1 -- 172.21.15.63:0/3327665581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fb8051660 msgr2=0x7f4fb8051a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.931+0000 7f4fc852b640 1 --2- 172.21.15.63:0/3327665581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fb8051660 0x7f4fb8051a70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4fc006b820 tx=0x7f4fc00a6690 comp rx=0 tx=0).stop 2024-09-21T06:59:56.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.935+0000 7f4fc852b640 1 -- 172.21.15.63:0/3327665581 shutdown_connections 2024-09-21T06:59:56.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.935+0000 7f4fc852b640 1 --2- 172.21.15.63:0/3327665581 >> v2:172.21.15.63:3300/0 conn(0x7f4fb8054750 0x7f4fb8054b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.935+0000 7f4fc852b640 1 --2- 172.21.15.63:0/3327665581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fb8051660 0x7f4fb8051a70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.935+0000 7f4fc852b640 1 -- 172.21.15.63:0/3327665581 >> 172.21.15.63:0/3327665581 conn(0x7f4fb801d9d0 msgr2=0x7f4fb8039690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.935+0000 7f4fc852b640 1 -- 172.21.15.63:0/3327665581 shutdown_connections 2024-09-21T06:59:56.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.936+0000 7f588debf640 1 -- 172.21.15.63:0/4097764271 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58880af430 msgr2=0x7f58881694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.937+0000 7fc2697fa640 1 -- 172.21.15.63:0/3410243662 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fc264005580 con 0x7fc27c052390 2024-09-21T06:59:56.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.941+0000 7f9a8aa5c640 1 -- 172.21.15.63:0/4215278571 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a7c057590 msgr2=0x7f9a7c0e3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.941+0000 7f9a8aa5c640 1 --2- 172.21.15.63:0/4215278571 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a7c057590 0x7f9a7c0e3680 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9a780097e0 tx=0x7f9a7802a360 comp rx=0 tx=0).stop 2024-09-21T06:59:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.936+0000 7f588debf640 1 --2- 172.21.15.63:0/4097764271 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58880af430 0x7f58881694d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f587c009900 tx=0x7f587c02a400 comp rx=0 tx=0).stop 2024-09-21T06:59:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.939+0000 7f4fc852b640 1 -- 172.21.15.63:0/3327665581 wait complete. 2024-09-21T06:59:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.941+0000 7f4fc852b640 1 Processor -- start 2024-09-21T06:59:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.944+0000 7ff7c5362640 1 -- 172.21.15.63:0/433842269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7ff7c00b4ae0 con 0x7ff7c01fda60 2024-09-21T06:59:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.944+0000 7f588debf640 1 -- 172.21.15.63:0/4097764271 shutdown_connections 2024-09-21T06:59:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.944+0000 7f588debf640 1 --2- 172.21.15.63:0/4097764271 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58880af430 0x7f58881694d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.944+0000 7f588debf640 1 -- 172.21.15.63:0/4097764271 >> 172.21.15.63:0/4097764271 conn(0x7f58880b6580 msgr2=0x7f58880b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.944+0000 7f9a8aa5c640 1 -- 172.21.15.63:0/4215278571 shutdown_connections 2024-09-21T06:59:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.944+0000 7f9a8aa5c640 1 --2- 172.21.15.63:0/4215278571 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a7c057590 0x7f9a7c0e3680 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.944+0000 7f9a8aa5c640 1 -- 172.21.15.63:0/4215278571 >> 172.21.15.63:0/4215278571 conn(0x7f9a7c055ea0 msgr2=0x7f9a7c00e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.948+0000 7fc26b7fe640 1 -- 172.21.15.63:0/3410243662 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fc27801ab70 con 0x7fc27c052390 2024-09-21T06:59:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.942+0000 7f4fc852b640 1 -- start start 2024-09-21T06:59:56.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.951+0000 7f9a8aa5c640 1 -- 172.21.15.63:0/4215278571 shutdown_connections 2024-09-21T06:59:56.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.951+0000 7fc2697fa640 1 -- 172.21.15.63:0/3410243662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc27c052390 msgr2=0x7fc27c181be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.951+0000 7fc2697fa640 1 --2- 172.21.15.63:0/3410243662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc27c052390 0x7fc27c181be0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc27800c4e0 tx=0x7fc27800c9a0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.951+0000 7fc2697fa640 1 -- 172.21.15.63:0/3410243662 shutdown_connections 2024-09-21T06:59:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.951+0000 7fc2697fa640 1 --2- 172.21.15.63:0/3410243662 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc27c182120 0x7fc27c032c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.951+0000 7fc2697fa640 1 --2- 172.21.15.63:0/3410243662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc27c0e7200 0x7fc27c032720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.951+0000 7fc2697fa640 1 --2- 172.21.15.63:0/3410243662 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc27c052390 0x7fc27c181be0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.951+0000 7fc2697fa640 1 -- 172.21.15.63:0/3410243662 >> 172.21.15.63:0/3410243662 conn(0x7fc27c01d9d0 msgr2=0x7fc27c005080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.951+0000 7f588debf640 1 -- 172.21.15.63:0/4097764271 shutdown_connections 2024-09-21T06:59:56.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.951+0000 7fc2697fa640 1 -- 172.21.15.63:0/3410243662 shutdown_connections 2024-09-21T06:59:56.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.951+0000 7fc2697fa640 1 -- 172.21.15.63:0/3410243662 wait complete. 2024-09-21T06:59:56.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.951+0000 7f9a8aa5c640 1 -- 172.21.15.63:0/4215278571 wait complete. 2024-09-21T06:59:56.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.954+0000 7f9a8aa5c640 1 Processor -- start 2024-09-21T06:59:56.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.952+0000 7f588debf640 1 -- 172.21.15.63:0/4097764271 wait complete. 2024-09-21T06:59:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.944+0000 7f4fc852b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fb8051660 0x7f4fb804dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.955+0000 7f588debf640 1 Processor -- start 2024-09-21T06:59:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.944+0000 7f4fc852b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8052390 0x7f4fb804c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.944+0000 7f4fc852b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fb8054750 0x7f4fb804cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.944+0000 7f4fc852b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb80527a0 con 0x7f4fb8052390 2024-09-21T06:59:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.955+0000 7f588debf640 1 -- start start 2024-09-21T06:59:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.944+0000 7f4fc852b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb8033f20 con 0x7f4fb8054750 2024-09-21T06:59:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.944+0000 7f4fc852b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4fb8052920 con 0x7f4fb8051660 2024-09-21T06:59:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.948+0000 7f4fc5ac6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8052390 0x7f4fb804c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.951+0000 7f4fc62c7640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fb8051660 0x7f4fb804dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.952+0000 7f4fc62c7640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fb8051660 0x7f4fb804dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:56442/0 (socket says 172.21.15.63:56442) 2024-09-21T06:59:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.952+0000 7f4fc62c7640 1 -- 172.21.15.63:0/2196079743 learned_addr learned my addr 172.21.15.63:0/2196079743 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.956+0000 7f4fc6ac8640 1 --2- 172.21.15.63:0/2196079743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fb8054750 0x7f4fb804cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.956+0000 7f4fc5ac6640 1 -- 172.21.15.63:0/2196079743 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fb8051660 msgr2=0x7f4fb804dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.956+0000 7f4fc5ac6640 1 --2- 172.21.15.63:0/2196079743 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fb8051660 0x7f4fb804dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.956+0000 7f4fc5ac6640 1 -- 172.21.15.63:0/2196079743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fb8054750 msgr2=0x7f4fb804cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.956+0000 7f4fc5ac6640 1 --2- 172.21.15.63:0/2196079743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fb8054750 0x7f4fb804cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.956+0000 7f4fc5ac6640 1 -- 172.21.15.63:0/2196079743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb80d8b60 con 0x7f4fb8052390 2024-09-21T06:59:56.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.954+0000 7f9a8aa5c640 1 -- start start 2024-09-21T06:59:56.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.956+0000 7f9a8aa5c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a7c057590 0x7f9a7c186060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.956+0000 7f4fc6ac8640 1 --2- 172.21.15.63:0/2196079743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fb8054750 0x7f4fb804cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:59:56.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.957+0000 7f9a8aa5c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a7c0e0c40 0x7f9a7c0ddce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.957+0000 7f9a8aa5c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a7c0de220 0x7f9a7c0de630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.957+0000 7ff7b77fe640 1 -- 172.21.15.63:0/433842269 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v11)=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7ff7b0014070 con 0x7ff7c01fda60 2024-09-21T06:59:56.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.957+0000 7f9a8aa5c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c037d50 con 0x7f9a7c0de220 2024-09-21T06:59:56.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.957+0000 7f9a8aa5c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c037bd0 con 0x7f9a7c057590 2024-09-21T06:59:56.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.957+0000 7f9a8aa5c640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7c037ed0 con 0x7f9a7c0e0c40 2024-09-21T06:59:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.958+0000 7ff06f24d640 1 -- 172.21.15.63:0/2990341314 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff0680cc270 msgr2=0x7ff0680b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.958+0000 7ff06f24d640 1 --2- 172.21.15.63:0/2990341314 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff0680cc270 0x7ff0680b3050 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff058009830 tx=0x7ff05802c770 comp rx=0 tx=0).stop 2024-09-21T06:59:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.958+0000 7f588debf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f588806cdb0 0x7f588814eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.958+0000 7f588debf640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58880af430 0x7f58880711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.958+0000 7f588debf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58880d0b00 0x7f5888071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.959+0000 7f9a88ff9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a7c0de220 0x7f9a7c0de630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.959+0000 7f9a88ff9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a7c0de220 0x7f9a7c0de630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44660/0 (socket says 172.21.15.63:44660) 2024-09-21T06:59:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.959+0000 7f9a88ff9640 1 -- 172.21.15.63:0/1583622457 learned_addr learned my addr 172.21.15.63:0/1583622457 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.959+0000 7ff06f24d640 1 -- 172.21.15.63:0/2990341314 shutdown_connections 2024-09-21T06:59:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.959+0000 7ff06f24d640 1 --2- 172.21.15.63:0/2990341314 >> v2:172.21.15.63:3300/0 conn(0x7ff0680cd090 0x7ff0680caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.959+0000 7ff06f24d640 1 --2- 172.21.15.63:0/2990341314 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff0680cc270 0x7ff0680b3050 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.959+0000 7ff06f24d640 1 -- 172.21.15.63:0/2990341314 >> 172.21.15.63:0/2990341314 conn(0x7ff0680b1d50 msgr2=0x7ff0680b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.958+0000 7f588debf640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5888169da0 con 0x7f588806cdb0 2024-09-21T06:59:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.959+0000 7f9a837fe640 1 --2- 172.21.15.63:0/1583622457 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a7c0e0c40 0x7f9a7c0ddce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f9a83fff640 1 --2- 172.21.15.63:0/1583622457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a7c057590 0x7f9a7c186060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f9a837fe640 1 -- 172.21.15.63:0/1583622457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a7c057590 msgr2=0x7f9a7c186060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f9a837fe640 1 --2- 172.21.15.63:0/1583622457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a7c057590 0x7f9a7c186060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f9a837fe640 1 -- 172.21.15.63:0/1583622457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a7c0de220 msgr2=0x7f9a7c0de630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f9a837fe640 1 --2- 172.21.15.63:0/1583622457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a7c0de220 0x7f9a7c0de630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f9a837fe640 1 -- 172.21.15.63:0/1583622457 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c0deb70 con 0x7f9a7c0e0c40 2024-09-21T06:59:56.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f9a88ff9640 1 --2- 172.21.15.63:0/1583622457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a7c0de220 0x7f9a7c0de630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:59:56.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.958+0000 7f588debf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5888169c20 con 0x7f58880d0b00 2024-09-21T06:59:56.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.958+0000 7f588debf640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5888169f20 con 0x7f58880af430 2024-09-21T06:59:56.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f588cebd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f588806cdb0 0x7f588814eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f588cebd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f588806cdb0 0x7f588814eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44688/0 (socket says 172.21.15.63:44688) 2024-09-21T06:59:56.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f588cebd640 1 -- 172.21.15.63:0/4153599782 learned_addr learned my addr 172.21.15.63:0/4153599782 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:56.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f588d6be640 1 --2- 172.21.15.63:0/4153599782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58880d0b00 0x7f5888071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f5887fff640 1 --2- 172.21.15.63:0/4153599782 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58880af430 0x7f58880711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f588d6be640 1 -- 172.21.15.63:0/4153599782 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58880af430 msgr2=0x7f58880711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f588d6be640 1 --2- 172.21.15.63:0/4153599782 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58880af430 0x7f58880711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.960+0000 7f588d6be640 1 -- 172.21.15.63:0/4153599782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f588806cdb0 msgr2=0x7f588814eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.961+0000 7f588d6be640 1 --2- 172.21.15.63:0/4153599782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f588806cdb0 0x7f588814eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.961+0000 7f588d6be640 1 -- 172.21.15.63:0/4153599782 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58881fa450 con 0x7f58880d0b00 2024-09-21T06:59:56.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.961+0000 7f588cebd640 1 --2- 172.21.15.63:0/4153599782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f588806cdb0 0x7f588814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:59:56.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.961+0000 7f588d6be640 1 --2- 172.21.15.63:0/4153599782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58880d0b00 0x7f5888071700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f587c031000 tx=0x7f587c003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:56.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.961+0000 7f5887fff640 1 --2- 172.21.15.63:0/4153599782 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58880af430 0x7f58880711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:59:56.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.962+0000 7ff7b57fa640 1 -- 172.21.15.63:0/433842269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7c01fda60 msgr2=0x7ff7c0158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.962+0000 7ff7b57fa640 1 --2- 172.21.15.63:0/433842269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7c01fda60 0x7ff7c0158850 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000fb70 tx=0x7ff7b000b730 comp rx=0 tx=0).stop 2024-09-21T06:59:56.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.963+0000 7ff06f24d640 1 -- 172.21.15.63:0/2990341314 shutdown_connections 2024-09-21T06:59:56.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.962+0000 7f9a837fe640 1 --2- 172.21.15.63:0/1583622457 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a7c0e0c40 0x7f9a7c0ddce0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9a8406c290 tx=0x7f9a840724b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:56.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.962+0000 7f9a80ff9640 1 -- 172.21.15.63:0/1583622457 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84090070 con 0x7f9a7c0e0c40 2024-09-21T06:59:56.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.962+0000 7f9a80ff9640 1 -- 172.21.15.63:0/1583622457 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a84072da0 con 0x7f9a7c0e0c40 2024-09-21T06:59:56.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.962+0000 7f9a80ff9640 1 -- 172.21.15.63:0/1583622457 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84094610 con 0x7f9a7c0e0c40 2024-09-21T06:59:56.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.962+0000 7f9a8aa5c640 1 -- 172.21.15.63:0/1583622457 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7c03a9c0 con 0x7f9a7c0e0c40 2024-09-21T06:59:56.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.962+0000 7f9a8aa5c640 1 -- 172.21.15.63:0/1583622457 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7c03af80 con 0x7f9a7c0e0c40 2024-09-21T06:59:56.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.963+0000 7f9a80ff9640 1 -- 172.21.15.63:0/1583622457 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9a84093070 con 0x7f9a7c0e0c40 2024-09-21T06:59:56.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.963+0000 7f9a80ff9640 1 -- 172.21.15.63:0/1583622457 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9a84095900 con 0x7f9a7c0e0c40 2024-09-21T06:59:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.964+0000 7f29a4f90640 1 -- 172.21.15.63:0/3738541421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a00710b0 msgr2=0x7f29a00709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.964+0000 7f29a4f90640 1 --2- 172.21.15.63:0/3738541421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a00710b0 0x7f29a00709b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f29a00b2db0 tx=0x7f299802a510 comp rx=0 tx=0).stop 2024-09-21T06:59:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.965+0000 7f58857fa640 1 -- 172.21.15.63:0/4153599782 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c040020 con 0x7f58880d0b00 2024-09-21T06:59:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.965+0000 7f29a4f90640 1 -- 172.21.15.63:0/3738541421 shutdown_connections 2024-09-21T06:59:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.965+0000 7f29a4f90640 1 --2- 172.21.15.63:0/3738541421 >> v2:172.21.15.71:3300/0 conn(0x7f29a00af410 0x7f29a00ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.965+0000 7f29a4f90640 1 --2- 172.21.15.63:0/3738541421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a00710b0 0x7f29a00709b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.965+0000 7f29a4f90640 1 -- 172.21.15.63:0/3738541421 >> 172.21.15.63:0/3738541421 conn(0x7f29a006d3e0 msgr2=0x7f29a00b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.965+0000 7f29a4f90640 1 -- 172.21.15.63:0/3738541421 shutdown_connections 2024-09-21T06:59:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.966+0000 7ff7b57fa640 1 -- 172.21.15.63:0/433842269 shutdown_connections 2024-09-21T06:59:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.966+0000 7ff7b57fa640 1 --2- 172.21.15.63:0/433842269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7c01437f0 0x7ff7c01fd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.966+0000 7ff7b57fa640 1 --2- 172.21.15.63:0/433842269 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7c01433e0 0x7ff7c01fce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.966+0000 7ff7b57fa640 1 --2- 172.21.15.63:0/433842269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7c01fda60 0x7ff7c0158850 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.966+0000 7ff7b57fa640 1 -- 172.21.15.63:0/433842269 >> 172.21.15.63:0/433842269 conn(0x7ff7c00cd510 msgr2=0x7ff7c00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.965+0000 7f588debf640 1 -- 172.21.15.63:0/4153599782 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58881fa730 con 0x7f58880d0b00 2024-09-21T06:59:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.965+0000 7f588debf640 1 -- 172.21.15.63:0/4153599782 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58881facf0 con 0x7f58880d0b00 2024-09-21T06:59:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.966+0000 7f58857fa640 1 -- 172.21.15.63:0/4153599782 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f587c004a00 con 0x7f58880d0b00 2024-09-21T06:59:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.964+0000 7ff06f24d640 1 -- 172.21.15.63:0/2990341314 wait complete. 2024-09-21T06:59:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.966+0000 7f58857fa640 1 -- 172.21.15.63:0/4153599782 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c004e10 con 0x7f58880d0b00 2024-09-21T06:59:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.966+0000 7ff7b57fa640 1 -- 172.21.15.63:0/433842269 shutdown_connections 2024-09-21T06:59:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.966+0000 7f4fc5ac6640 1 --2- 172.21.15.63:0/2196079743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8052390 0x7f4fb804c8a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4fc006b9c0 tx=0x7f4fc00ac850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:56.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.967+0000 7ff06f24d640 1 Processor -- start 2024-09-21T06:59:56.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.967+0000 7f9b5bfff640 1 -- 172.21.15.63:0/425372178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b5c159e80 msgr2=0x7f9b5c15a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.967+0000 7f9b5bfff640 1 --2- 172.21.15.63:0/425372178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b5c159e80 0x7f9b5c15a290 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c072db0 tx=0x7f9b5002a530 comp rx=0 tx=0).stop 2024-09-21T06:59:56.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.967+0000 7ff7b57fa640 1 -- 172.21.15.63:0/433842269 wait complete. 2024-09-21T06:59:56.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.967+0000 7f9b5bfff640 1 -- 172.21.15.63:0/425372178 shutdown_connections 2024-09-21T06:59:56.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.967+0000 7f9b5bfff640 1 --2- 172.21.15.63:0/425372178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b5c159e80 0x7f9b5c15a290 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.967+0000 7f9b5bfff640 1 --2- 172.21.15.63:0/425372178 >> v2:172.21.15.63:3300/0 conn(0x7f9b5c0733e0 0x7f9b5c162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.967+0000 7f9b5bfff640 1 -- 172.21.15.63:0/425372178 >> 172.21.15.63:0/425372178 conn(0x7f9b5c0b1c50 msgr2=0x7f9b5c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.968+0000 7f588debf640 1 -- 172.21.15.63:0/4153599782 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f588806d5d0 con 0x7f58880d0b00 2024-09-21T06:59:56.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.965+0000 7f29a4f90640 1 -- 172.21.15.63:0/3738541421 wait complete. 2024-09-21T06:59:56.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.965+0000 7f9a6e7fc640 1 -- 172.21.15.63:0/1583622457 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a64005290 con 0x7f9a7c0e0c40 2024-09-21T06:59:56.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.968+0000 7f9a80ff9640 1 -- 172.21.15.63:0/1583622457 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9a84095b00 con 0x7f9a7c0e0c40 2024-09-21T06:59:56.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7f4fb6ffd640 1 -- 172.21.15.63:0/2196079743 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00bb070 con 0x7f4fb8052390 2024-09-21T06:59:56.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7f209f65c640 1 -- 172.21.15.63:0/2376752844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20980afbc0 msgr2=0x7f20980affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7f209f65c640 1 --2- 172.21.15.63:0/2376752844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20980afbc0 0x7f20980affd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f20980721d0 tx=0x7f208c02a5d0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7f58857fa640 1 -- 172.21.15.63:0/4153599782 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f587c043020 con 0x7f58880d0b00 2024-09-21T06:59:56.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7f29a4f90640 1 Processor -- start 2024-09-21T06:59:56.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7f58857fa640 1 -- 172.21.15.63:0/4153599782 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f587c03caa0 con 0x7f58880d0b00 2024-09-21T06:59:56.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7f9b5bfff640 1 -- 172.21.15.63:0/425372178 shutdown_connections 2024-09-21T06:59:56.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7f209f65c640 1 -- 172.21.15.63:0/2376752844 shutdown_connections 2024-09-21T06:59:56.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.972+0000 7f209f65c640 1 --2- 172.21.15.63:0/2376752844 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20980afbc0 0x7f20980affd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.972+0000 7f209f65c640 1 --2- 172.21.15.63:0/2376752844 >> v2:172.21.15.63:3300/0 conn(0x7f20980ccc80 0x7f20980cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.972+0000 7f209f65c640 1 -- 172.21.15.63:0/2376752844 >> 172.21.15.63:0/2376752844 conn(0x7f20980b1d50 msgr2=0x7f20980b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.967+0000 7ff06f24d640 1 -- start start 2024-09-21T06:59:56.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7ff06f24d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff0680cc270 0x7ff0680ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7ff06f24d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0680ccc80 0x7ff068214d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.972+0000 7ff06f24d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0680cd090 0x7ff0680b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.972+0000 7ff06f24d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680b2c00 con 0x7ff0680cd090 2024-09-21T06:59:56.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.972+0000 7ff06f24d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff0680b2a80 con 0x7ff0680ccc80 2024-09-21T06:59:56.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.972+0000 7ff06f24d640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff0680cb4a0 con 0x7ff0680cc270 2024-09-21T06:59:56.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.972+0000 7ff06d7ea640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0680cd090 0x7ff0680b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.972+0000 7ff06d7ea640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0680cd090 0x7ff0680b07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44696/0 (socket says 172.21.15.63:44696) 2024-09-21T06:59:56.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.972+0000 7ff06d7ea640 1 -- 172.21.15.63:0/3278946355 learned_addr learned my addr 172.21.15.63:0/3278946355 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:56.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.973+0000 7ff06d7ea640 1 -- 172.21.15.63:0/3278946355 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff0680cc270 msgr2=0x7ff0680ada40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:59:56.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.973+0000 7ff06d7ea640 1 --2- 172.21.15.63:0/3278946355 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff0680cc270 0x7ff0680ada40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.973+0000 7ff06d7ea640 1 -- 172.21.15.63:0/3278946355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0680ccc80 msgr2=0x7ff068214d10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:59:56.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.973+0000 7ff06d7ea640 1 --2- 172.21.15.63:0/3278946355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0680ccc80 0x7ff068214d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.973+0000 7ff06d7ea640 1 -- 172.21.15.63:0/3278946355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0680af740 con 0x7ff0680cd090 2024-09-21T06:59:56.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.973+0000 7ff06d7ea640 1 --2- 172.21.15.63:0/3278946355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0680cd090 0x7ff0680b07c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff05c00f880 tx=0x7ff05c00fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:56.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7ff0657fa640 1 -- 172.21.15.63:0/3278946355 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c00dbd0 con 0x7ff0680cd090 2024-09-21T06:59:56.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7f4fc852b640 1 -- 172.21.15.63:0/2196079743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb8048240 con 0x7f4fb8052390 2024-09-21T06:59:56.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7f4fc852b640 1 -- 172.21.15.63:0/2196079743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb804a690 con 0x7f4fb8052390 2024-09-21T06:59:56.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7f4fb6ffd640 1 -- 172.21.15.63:0/2196079743 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4fc00b7440 con 0x7f4fb8052390 2024-09-21T06:59:56.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.972+0000 7f4fb6ffd640 1 -- 172.21.15.63:0/2196079743 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00b7810 con 0x7f4fb8052390 2024-09-21T06:59:56.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f4fb6ffd640 1 -- 172.21.15.63:0/2196079743 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4fc00be070 con 0x7f4fb8052390 2024-09-21T06:59:56.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f4fb6ffd640 1 -- 172.21.15.63:0/2196079743 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4fc00c0790 con 0x7f4fb8052390 2024-09-21T06:59:56.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7f29a4f90640 1 -- start start 2024-09-21T06:59:56.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f29a4f90640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a00710b0 0x7f29a00995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f29a4f90640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29a00af410 0x7f29a00c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f29a4f90640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f29a00cec90 0x7f29a00c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f29a4f90640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f29a015bf00 con 0x7f29a00710b0 2024-09-21T06:59:56.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f29a4f90640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f29a015bd80 con 0x7f29a00af410 2024-09-21T06:59:56.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f29a4f90640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f29a00ccbd0 con 0x7f29a00cec90 2024-09-21T06:59:56.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f299ed9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f29a00cec90 0x7f29a00c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f299ed9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f29a00cec90 0x7f29a00c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:56502/0 (socket says 172.21.15.63:56502) 2024-09-21T06:59:56.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f299ed9d640 1 -- 172.21.15.63:0/4100275976 learned_addr learned my addr 172.21.15.63:0/4100275976 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:56.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f299dd9b640 1 --2- 172.21.15.63:0/4100275976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29a00af410 0x7f29a00c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.971+0000 7f9b5bfff640 1 -- 172.21.15.63:0/425372178 wait complete. 2024-09-21T06:59:56.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f9b5bfff640 1 Processor -- start 2024-09-21T06:59:56.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7ff06f24d640 1 -- 172.21.15.63:0/3278946355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0680afa00 con 0x7ff0680cd090 2024-09-21T06:59:56.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.975+0000 7f58857fa640 1 -- 172.21.15.63:0/4153599782 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f588806d5d0 con 0x7f58880d0b00 2024-09-21T06:59:56.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.975+0000 7f299ed9d640 1 -- 172.21.15.63:0/4100275976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29a00af410 msgr2=0x7f29a00c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.975+0000 7f299ed9d640 1 --2- 172.21.15.63:0/4100275976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29a00af410 0x7f29a00c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.975+0000 7f299ed9d640 1 -- 172.21.15.63:0/4100275976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a00710b0 msgr2=0x7f29a00995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.975+0000 7f299ed9d640 1 --2- 172.21.15.63:0/4100275976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a00710b0 0x7f29a00995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.975+0000 7f299ed9d640 1 -- 172.21.15.63:0/4100275976 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a00c4790 con 0x7f29a00cec90 2024-09-21T06:59:56.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7ff06f24d640 1 -- 172.21.15.63:0/3278946355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0680affc0 con 0x7ff0680cd090 2024-09-21T06:59:56.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.976+0000 7f299ed9d640 1 --2- 172.21.15.63:0/4100275976 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f29a00cec90 0x7f29a00c6530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f298800c3c0 tx=0x7f298800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:56.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.976+0000 7f2996ffd640 1 -- 172.21.15.63:0/4100275976 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988011790 con 0x7f29a00cec90 2024-09-21T06:59:56.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f2996ffd640 1 -- 172.21.15.63:0/4100275976 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2988017070 con 0x7f29a00cec90 2024-09-21T06:59:56.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f29a4f90640 1 -- 172.21.15.63:0/4100275976 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a0099e20 con 0x7f29a00cec90 2024-09-21T06:59:56.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f29a4f90640 1 -- 172.21.15.63:0/4100275976 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a009c2f0 con 0x7f29a00cec90 2024-09-21T06:59:56.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.974+0000 7f9b5bfff640 1 -- start start 2024-09-21T06:59:56.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f9b5bfff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b5c0733e0 0x7f9b5c158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f4fc852b640 1 -- 172.21.15.63:0/2196079743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa8005290 con 0x7f4fb8052390 2024-09-21T06:59:56.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.978+0000 7f209f65c640 1 -- 172.21.15.63:0/2376752844 shutdown_connections 2024-09-21T06:59:56.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f9b5bfff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b5c0acf30 0x7f9b5c158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.979+0000 7f2996ffd640 1 -- 172.21.15.63:0/4100275976 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988011ca0 con 0x7f29a00cec90 2024-09-21T06:59:56.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.979+0000 7f2996ffd640 1 -- 172.21.15.63:0/4100275976 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f298801c460 con 0x7f29a00cec90 2024-09-21T06:59:56.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.979+0000 7f2996ffd640 1 -- 172.21.15.63:0/4100275976 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f29880128f0 con 0x7f29a00cec90 2024-09-21T06:59:56.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.980+0000 7f2994ff9640 1 -- 172.21.15.63:0/4100275976 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2984005290 con 0x7f29a00cec90 2024-09-21T06:59:56.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.978+0000 7f209f65c640 1 -- 172.21.15.63:0/2376752844 wait complete. 2024-09-21T06:59:56.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.981+0000 7f209f65c640 1 Processor -- start 2024-09-21T06:59:56.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f9b5affd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b5c0733e0 0x7f9b5c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f9b5affd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b5c0733e0 0x7f9b5c158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:56508/0 (socket says 172.21.15.63:56508) 2024-09-21T06:59:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f9b5a7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b5c0acf30 0x7f9b5c158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f9b5a7fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b5c0acf30 0x7f9b5c158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53944/0 (socket says 172.21.15.63:53944) 2024-09-21T06:59:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f9b5a7fc640 1 -- 172.21.15.63:0/1835857363 learned_addr learned my addr 172.21.15.63:0/1835857363 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f9b5bfff640 1 --2- 172.21.15.63:0/1835857363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b5c159e80 0x7f9b5c141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f9b5bfff640 1 -- 172.21.15.63:0/1835857363 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c15ac70 con 0x7f9b5c159e80 2024-09-21T06:59:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f9b5bfff640 1 -- 172.21.15.63:0/1835857363 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5c15aaf0 con 0x7f9b5c0acf30 2024-09-21T06:59:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.977+0000 7f9b5bfff640 1 -- 172.21.15.63:0/1835857363 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f9b5c06fa60 con 0x7f9b5c0733e0 2024-09-21T06:59:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.978+0000 7f9b5affd640 1 -- 172.21.15.63:0/1835857363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b5c0acf30 msgr2=0x7f9b5c158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.982+0000 7f2996ffd640 1 -- 172.21.15.63:0/4100275976 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2988012af0 con 0x7f29a00cec90 2024-09-21T06:59:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.978+0000 7f9b5affd640 1 --2- 172.21.15.63:0/1835857363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b5c0acf30 0x7f9b5c158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.978+0000 7f9b5affd640 1 -- 172.21.15.63:0/1835857363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b5c159e80 msgr2=0x7f9b5c141160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T06:59:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.978+0000 7f9b5affd640 1 --2- 172.21.15.63:0/1835857363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b5c159e80 0x7f9b5c141160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.978+0000 7f9b5affd640 1 -- 172.21.15.63:0/1835857363 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b5c0ad6e0 con 0x7f9b5c0733e0 2024-09-21T06:59:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.981+0000 7f9b5affd640 1 --2- 172.21.15.63:0/1835857363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b5c0733e0 0x7f9b5c158030 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00c370 tx=0x7f9b4c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.982+0000 7f9b437fe640 1 -- 172.21.15.63:0/1835857363 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c011790 con 0x7f9b5c0733e0 2024-09-21T06:59:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.982+0000 7f209f65c640 1 -- start start 2024-09-21T06:59:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.984+0000 7f209f65c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20980afbc0 0x7f20980b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.984+0000 7f209f65c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20980b0510 0x7f20980b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.984+0000 7f209f65c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20980ccc80 0x7f20980c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.984+0000 7f209f65c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f20980b2a80 con 0x7f20980b0510 2024-09-21T06:59:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.984+0000 7f209f65c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f20980cff30 con 0x7f20980ccc80 2024-09-21T06:59:56.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.984+0000 7f209f65c640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f20980b2c00 con 0x7f20980afbc0 2024-09-21T06:59:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.983+0000 7f9b5bfff640 1 -- 172.21.15.63:0/1835857363 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b5c0ad9c0 con 0x7f9b5c0733e0 2024-09-21T06:59:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.983+0000 7f9b5bfff640 1 -- 172.21.15.63:0/1835857363 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b5c0adf80 con 0x7f9b5c0733e0 2024-09-21T06:59:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.984+0000 7f9b437fe640 1 -- 172.21.15.63:0/1835857363 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b4c017070 con 0x7f9b5c0733e0 2024-09-21T06:59:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.984+0000 7f9b437fe640 1 -- 172.21.15.63:0/1835857363 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c011ca0 con 0x7f9b5c0733e0 2024-09-21T06:59:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.985+0000 7f9b437fe640 1 -- 172.21.15.63:0/1835857363 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9b4c01c460 con 0x7f9b5c0733e0 2024-09-21T06:59:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.985+0000 7f9b437fe640 1 -- 172.21.15.63:0/1835857363 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9b4c012820 con 0x7f9b5c0733e0 2024-09-21T06:59:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.985+0000 7f209cbf7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20980b0510 0x7f20980b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.985+0000 7f209cbf7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20980b0510 0x7f20980b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44742/0 (socket says 172.21.15.63:44742) 2024-09-21T06:59:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.985+0000 7f209cbf7640 1 -- 172.21.15.63:0/2532622579 learned_addr learned my addr 172.21.15.63:0/2532622579 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.985+0000 7f209dbf9640 1 --2- 172.21.15.63:0/2532622579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20980ccc80 0x7f20980c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.985+0000 7f209d3f8640 1 --2- 172.21.15.63:0/2532622579 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20980afbc0 0x7f20980b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:56.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.987+0000 7f93380dc640 1 -- 172.21.15.63:0/7131706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93300cce60 msgr2=0x7f9330073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.988+0000 7f93380dc640 1 --2- 172.21.15.63:0/7131706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93300cce60 0x7f9330073dc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93300cc6a0 tx=0x7f932802b960 comp rx=0 tx=0).stop 2024-09-21T06:59:56.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.988+0000 7f93380dc640 1 -- 172.21.15.63:0/7131706 shutdown_connections 2024-09-21T06:59:56.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.988+0000 7f93380dc640 1 --2- 172.21.15.63:0/7131706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93300cce60 0x7f9330073dc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.988+0000 7f93380dc640 1 --2- 172.21.15.63:0/7131706 >> v2:172.21.15.71:3300/0 conn(0x7f9330144800 0x7f9330073880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.988+0000 7f93380dc640 1 -- 172.21.15.63:0/7131706 >> 172.21.15.63:0/7131706 conn(0x7f93300cd510 msgr2=0x7f93300cd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.991+0000 7f93380dc640 1 -- 172.21.15.63:0/7131706 shutdown_connections 2024-09-21T06:59:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.991+0000 7f93380dc640 1 -- 172.21.15.63:0/7131706 wait complete. 2024-09-21T06:59:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.989+0000 7f209cbf7640 1 -- 172.21.15.63:0/2532622579 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20980afbc0 msgr2=0x7f20980b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.989+0000 7f209cbf7640 1 --2- 172.21.15.63:0/2532622579 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20980afbc0 0x7f20980b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.989+0000 7f209cbf7640 1 -- 172.21.15.63:0/2532622579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20980ccc80 msgr2=0x7f20980c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.989+0000 7f209cbf7640 1 --2- 172.21.15.63:0/2532622579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20980ccc80 0x7f20980c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.989+0000 7f209cbf7640 1 -- 172.21.15.63:0/2532622579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209815d240 con 0x7f20980b0510 2024-09-21T06:59:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.989+0000 7f209cbf7640 1 --2- 172.21.15.63:0/2532622579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20980b0510 0x7f20980b4710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f208c009850 tx=0x7f208c004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.990+0000 7f2095ffb640 1 -- 172.21.15.63:0/2532622579 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c03e030 con 0x7f20980b0510 2024-09-21T06:59:56.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.990+0000 7f2095ffb640 1 -- 172.21.15.63:0/2532622579 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f208c003800 con 0x7f20980b0510 2024-09-21T06:59:56.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.990+0000 7f2095ffb640 1 -- 172.21.15.63:0/2532622579 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c035040 con 0x7f20980b0510 2024-09-21T06:59:56.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.991+0000 7f209f65c640 1 -- 172.21.15.63:0/2532622579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209815dae0 con 0x7f20980b0510 2024-09-21T06:59:56.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.991+0000 7f209f65c640 1 -- 172.21.15.63:0/2532622579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209815d800 con 0x7f20980b0510 2024-09-21T06:59:56.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.990+0000 7ff0657fa640 1 -- 172.21.15.63:0/3278946355 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff05c00de60 con 0x7ff0680cd090 2024-09-21T06:59:56.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.990+0000 7ff0657fa640 1 -- 172.21.15.63:0/3278946355 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c00dbd0 con 0x7ff0680cd090 2024-09-21T06:59:56.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.991+0000 7ff0657fa640 1 -- 172.21.15.63:0/3278946355 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff05c0053b0 con 0x7ff0680cd090 2024-09-21T06:59:56.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.991+0000 7ff0657fa640 1 -- 172.21.15.63:0/3278946355 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff05c014070 con 0x7ff0680cd090 2024-09-21T06:59:56.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.985+0000 7f4fb6ffd640 1 -- 172.21.15.63:0/2196079743 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4fc00b7df0 con 0x7f4fb8052390 2024-09-21T06:59:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.987+0000 7f9b5bfff640 1 -- 172.21.15.63:0/1835857363 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c005290 con 0x7f9b5c0733e0 2024-09-21T06:59:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.989+0000 7f9b437fe640 1 -- 172.21.15.63:0/1835857363 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9b4c012a70 con 0x7f9b5c0733e0 2024-09-21T06:59:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.989+0000 7f2c26269640 1 -- 172.21.15.63:0/2532007431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200ad030 msgr2=0x7f2c20162840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.989+0000 7f2c26269640 1 --2- 172.21.15.63:0/2532007431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200ad030 0x7f2c20162840 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2c200cda80 tx=0x7f2c1802aac0 comp rx=0 tx=0).stop 2024-09-21T06:59:56.998 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi063') 2024-09-21T06:59:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.993+0000 7ff06f24d640 1 -- 172.21.15.63:0/3278946355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff048005290 con 0x7ff0680cd090 2024-09-21T06:59:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.995+0000 7f93380dc640 1 Processor -- start 2024-09-21T06:59:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.995+0000 7f93380dc640 1 -- start start 2024-09-21T06:59:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.997+0000 7f2c26269640 1 -- 172.21.15.63:0/2532007431 shutdown_connections 2024-09-21T06:59:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.997+0000 7f2c26269640 1 --2- 172.21.15.63:0/2532007431 >> v2:172.21.15.63:3300/0 conn(0x7f2c20162d80 0x7f2c200ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.997+0000 7f2c26269640 1 --2- 172.21.15.63:0/2532007431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200ad030 0x7f2c20162840 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.997+0000 7f2c26269640 1 -- 172.21.15.63:0/2532007431 >> 172.21.15.63:0/2532007431 conn(0x7f2c200b1d50 msgr2=0x7f2c200b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.997+0000 7ff0657fa640 1 -- 172.21.15.63:0/3278946355 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff05c027080 con 0x7ff0680cd090 2024-09-21T06:59:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.996+0000 7f209f65c640 1 -- 172.21.15.63:0/2532622579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20980ae120 con 0x7f20980b0510 2024-09-21T06:59:57.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.997+0000 7f2095ffb640 1 -- 172.21.15.63:0/2532622579 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f208c041030 con 0x7f20980b0510 2024-09-21T06:59:57.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.997+0000 7f2095ffb640 1 -- 172.21.15.63:0/2532622579 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f208c043dd0 con 0x7f20980b0510 2024-09-21T06:59:57.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.998+0000 7f93380dc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93301443f0 0x7f93301e4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.999+0000 7f93380dc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9330144800 0x7f933013ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.999+0000 7f9335e78640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93301443f0 0x7f93301e4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.999+0000 7f9335e78640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93301443f0 0x7f93301e4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:56522/0 (socket says 172.21.15.63:56522) 2024-09-21T06:59:57.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.999+0000 7f9335e78640 1 -- 172.21.15.63:0/3122177162 learned_addr learned my addr 172.21.15.63:0/3122177162 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:57.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.999+0000 7f93380dc640 1 --2- 172.21.15.63:0/3122177162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f933015ebe0 0x7f933015eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.999+0000 7f93380dc640 1 -- 172.21.15.63:0/3122177162 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f93300cb0e0 con 0x7f933015ebe0 2024-09-21T06:59:57.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:56.999+0000 7f93380dc640 1 -- 172.21.15.63:0/3122177162 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9330069350 con 0x7f9330144800 2024-09-21T06:59:57.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.000+0000 7f93380dc640 1 -- 172.21.15.63:0/3122177162 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f93300cb260 con 0x7f93301443f0 2024-09-21T06:59:57.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.000+0000 7f2c26269640 1 -- 172.21.15.63:0/2532007431 shutdown_connections 2024-09-21T06:59:57.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.000+0000 7f2c26269640 1 -- 172.21.15.63:0/2532007431 wait complete. 2024-09-21T06:59:57.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.003+0000 7f2c26269640 1 Processor -- start 2024-09-21T06:59:57.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.003+0000 7f2c26269640 1 -- start start 2024-09-21T06:59:57.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.004+0000 7f9336679640 1 --2- 172.21.15.63:0/3122177162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f933015ebe0 0x7f933015eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.004+0000 7f9335677640 1 --2- 172.21.15.63:0/3122177162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9330144800 0x7f933013ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.004+0000 7f9335e78640 1 -- 172.21.15.63:0/3122177162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9330144800 msgr2=0x7f933013ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.005+0000 7f9335e78640 1 --2- 172.21.15.63:0/3122177162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9330144800 0x7f933013ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.005+0000 7f9335e78640 1 -- 172.21.15.63:0/3122177162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f933015ebe0 msgr2=0x7f933015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.005+0000 7f9335e78640 1 --2- 172.21.15.63:0/3122177162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f933015ebe0 0x7f933015eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.005+0000 7f9335e78640 1 -- 172.21.15.63:0/3122177162 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933015f530 con 0x7f93301443f0 2024-09-21T06:59:57.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.005+0000 7f2c26269640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200ad030 0x7f2c20098eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.005+0000 7f9336679640 1 --2- 172.21.15.63:0/3122177162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f933015ebe0 0x7f933015eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:59:57.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.005+0000 7f2c26269640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2c200ccc80 0x7f2c20160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.005+0000 7f2c26269640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c20162d80 0x7f2c20160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.005+0000 7f9335677640 1 --2- 172.21.15.63:0/3122177162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9330144800 0x7f933013ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:59:57.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.005+0000 7f2c26269640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2c200b2c00 con 0x7f2c20162d80 2024-09-21T06:59:57.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.006+0000 7f2c26269640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2c200b2a80 con 0x7f2c200ad030 2024-09-21T06:59:57.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.006+0000 7f2c26269640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2c200b1870 con 0x7f2c200ccc80 2024-09-21T06:59:57.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.006+0000 7f2c24806640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c20162d80 0x7f2c20160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.006+0000 7f2c24806640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c20162d80 0x7f2c20160e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44760/0 (socket says 172.21.15.63:44760) 2024-09-21T06:59:57.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.006+0000 7f2c24806640 1 -- 172.21.15.63:0/407512340 learned_addr learned my addr 172.21.15.63:0/407512340 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:57.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.006+0000 7f2c24806640 1 -- 172.21.15.63:0/407512340 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2c200ccc80 msgr2=0x7f2c20160930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:59:57.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.007+0000 7f2c24806640 1 --2- 172.21.15.63:0/407512340 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2c200ccc80 0x7f2c20160930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.007+0000 7f2c24806640 1 -- 172.21.15.63:0/407512340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200ad030 msgr2=0x7f2c20098eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T06:59:57.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.007+0000 7f2c24806640 1 --2- 172.21.15.63:0/407512340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200ad030 0x7f2c20098eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.007+0000 7f2c24806640 1 -- 172.21.15.63:0/407512340 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c20070c30 con 0x7f2c20162d80 2024-09-21T06:59:57.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.007+0000 7f2c24806640 1 --2- 172.21.15.63:0/407512340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c20162d80 0x7f2c20160e70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000b410 tx=0x7f2c1000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:57.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.006+0000 7f9335e78640 1 --2- 172.21.15.63:0/3122177162 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93301443f0 0x7f93301e4e50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f932400c430 tx=0x7f932400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:57.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.008+0000 7f93227fc640 1 -- 172.21.15.63:0/3122177162 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93240052d0 con 0x7f93301443f0 2024-09-21T06:59:57.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.008+0000 7f93380dc640 1 -- 172.21.15.63:0/3122177162 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93301f49f0 con 0x7f93301443f0 2024-09-21T06:59:57.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.008+0000 7f93380dc640 1 -- 172.21.15.63:0/3122177162 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f93301f4fb0 con 0x7f93301443f0 2024-09-21T06:59:57.012 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi063') 2024-09-21T06:59:57.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.010+0000 7f2095ffb640 1 -- 172.21.15.63:0/2532622579 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f20980cd5d0 con 0x7f20980b0510 2024-09-21T06:59:57.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.011+0000 7f93227fc640 1 -- 172.21.15.63:0/3122177162 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93240106a0 con 0x7f93301443f0 2024-09-21T06:59:57.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.011+0000 7f93227fc640 1 -- 172.21.15.63:0/3122177162 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9324010ab0 con 0x7f93301443f0 2024-09-21T06:59:57.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.011+0000 7f93227fc640 1 -- 172.21.15.63:0/3122177162 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9324010d10 con 0x7f93301443f0 2024-09-21T06:59:57.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.011+0000 7f93227fc640 1 -- 172.21.15.63:0/3122177162 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9324011b90 con 0x7f93301443f0 2024-09-21T06:59:57.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.013+0000 7f931bfff640 1 -- 172.21.15.63:0/3122177162 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9310005290 con 0x7f93301443f0 2024-09-21T06:59:57.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.013+0000 7f2c1cff9640 1 -- 172.21.15.63:0/407512340 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10015020 con 0x7f2c20162d80 2024-09-21T06:59:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.013+0000 7f2c26269640 1 -- 172.21.15.63:0/407512340 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c200c3f60 con 0x7f2c20162d80 2024-09-21T06:59:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.013+0000 7f2c26269640 1 -- 172.21.15.63:0/407512340 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c200c6380 con 0x7f2c20162d80 2024-09-21T06:59:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.014+0000 7f2c1cff9640 1 -- 172.21.15.63:0/407512340 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c10011920 con 0x7f2c20162d80 2024-09-21T06:59:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.014+0000 7f2c1cff9640 1 -- 172.21.15.63:0/407512340 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10011d70 con 0x7f2c20162d80 2024-09-21T06:59:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.015+0000 7f93227fc640 1 -- 172.21.15.63:0/3122177162 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f933015f530 con 0x7f93301443f0 2024-09-21T06:59:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.015+0000 7f2c1cff9640 1 -- 172.21.15.63:0/407512340 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2c10018020 con 0x7f2c20162d80 2024-09-21T06:59:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.015+0000 7f2c1cff9640 1 -- 172.21.15.63:0/407512340 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2c10019980 con 0x7f2c20162d80 2024-09-21T06:59:57.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.020+0000 7f2c26269640 1 -- 172.21.15.63:0/407512340 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c00005290 con 0x7f2c20162d80 2024-09-21T06:59:57.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.027+0000 7f2c1cff9640 1 -- 172.21.15.63:0/407512340 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2c1001f020 con 0x7f2c20162d80 2024-09-21T06:59:57.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.052+0000 7f96fa30b640 1 -- 172.21.15.63:0/3038960574 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f96d4005580 con 0x7f96f40c8470 2024-09-21T06:59:57.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.058+0000 7f96f0ff9640 1 -- 172.21.15.63:0/3038960574 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7f96ec00fbc0 con 0x7f96f40c8470 2024-09-21T06:59:57.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.060+0000 7f96fa30b640 1 -- 172.21.15.63:0/3038960574 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96f40c8470 msgr2=0x7f96f40c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.060+0000 7f96fa30b640 1 --2- 172.21.15.63:0/3038960574 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96f40c8470 0x7f96f40c8880 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f96ec005fd0 tx=0x7f96ec007b40 comp rx=0 tx=0).stop 2024-09-21T06:59:57.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.060+0000 7f96fa30b640 1 -- 172.21.15.63:0/3038960574 shutdown_connections 2024-09-21T06:59:57.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.060+0000 7f96fa30b640 1 --2- 172.21.15.63:0/3038960574 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96f40c8470 0x7f96f40c8880 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.060+0000 7f96fa30b640 1 --2- 172.21.15.63:0/3038960574 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f96f4096d90 0x7f96f420b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.060+0000 7f96fa30b640 1 --2- 172.21.15.63:0/3038960574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96dc003b30 0x7f96f420af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.060+0000 7f96fa30b640 1 -- 172.21.15.63:0/3038960574 >> 172.21.15.63:0/3038960574 conn(0x7f96f40b1d50 msgr2=0x7f96f4098cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.069+0000 7f96fa30b640 1 -- 172.21.15.63:0/3038960574 shutdown_connections 2024-09-21T06:59:57.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.081+0000 7f96fa30b640 1 -- 172.21.15.63:0/3038960574 wait complete. 2024-09-21T06:59:57.103 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi063') 2024-09-21T06:59:57.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.131+0000 7f39ca884640 1 -- 172.21.15.63:0/3486614517 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f39a4005580 con 0x7f39c408b4a0 2024-09-21T06:59:57.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.137+0000 7f39c0ff9640 1 -- 172.21.15.63:0/3486614517 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7f39bc003990 con 0x7f39c408b4a0 2024-09-21T06:59:57.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.149+0000 7fb07d7fa640 1 -- 172.21.15.63:0/2537784725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fb0980cce70 con 0x7fb098160320 2024-09-21T06:59:57.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.149+0000 7f39ca884640 1 -- 172.21.15.63:0/3486614517 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39c408b4a0 msgr2=0x7f39c409d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.150+0000 7f39ca884640 1 --2- 172.21.15.63:0/3486614517 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39c408b4a0 0x7f39c409d6a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00cc80 tx=0x7f39bc00a430 comp rx=0 tx=0).stop 2024-09-21T06:59:57.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.150+0000 7f39ca884640 1 -- 172.21.15.63:0/3486614517 shutdown_connections 2024-09-21T06:59:57.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.150+0000 7f39ca884640 1 --2- 172.21.15.63:0/3486614517 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39c40b4c10 0x7f39c41f1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.150+0000 7f39ca884640 1 --2- 172.21.15.63:0/3486614517 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f39c408b4a0 0x7f39c409d6a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.150+0000 7f39ca884640 1 --2- 172.21.15.63:0/3486614517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39c4074c00 0x7f39c41eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.150+0000 7f39ca884640 1 -- 172.21.15.63:0/3486614517 >> 172.21.15.63:0/3486614517 conn(0x7f39c40b1cc0 msgr2=0x7f39c40743b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.152+0000 7f39ca884640 1 -- 172.21.15.63:0/3486614517 shutdown_connections 2024-09-21T06:59:57.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.152+0000 7f39ca884640 1 -- 172.21.15.63:0/3486614517 wait complete. 2024-09-21T06:59:57.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.157+0000 7fb07f7fe640 1 -- 172.21.15.63:0/2537784725 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v14)=0 v14) ==== 119+0+0 (secure 0 0 0) 0x7fb0900109d0 con 0x7fb098160320 2024-09-21T06:59:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.148+0000 7f9b5bfff640 1 -- 172.21.15.63:0/1835857363 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f9b3c005580 con 0x7f9b5c0733e0 2024-09-21T06:59:57.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.160+0000 7fb07d7fa640 1 -- 172.21.15.63:0/2537784725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb098160320 msgr2=0x7fb098155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.160+0000 7fb07d7fa640 1 --2- 172.21.15.63:0/2537784725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb098160320 0x7fb098155620 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb090005fd0 tx=0x7fb09000c6a0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.160+0000 7fb07d7fa640 1 -- 172.21.15.63:0/2537784725 shutdown_connections 2024-09-21T06:59:57.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.160+0000 7fb07d7fa640 1 --2- 172.21.15.63:0/2537784725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb098160320 0x7fb098155620 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.160+0000 7fb07d7fa640 1 --2- 172.21.15.63:0/2537784725 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0980cca60 0x7fb09814fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.160+0000 7fb07d7fa640 1 --2- 172.21.15.63:0/2537784725 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb0980b4500 0x7fb0980cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.160+0000 7fb07d7fa640 1 -- 172.21.15.63:0/2537784725 >> 172.21.15.63:0/2537784725 conn(0x7fb0980b1cc0 msgr2=0x7fb0980b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.160+0000 7fb07d7fa640 1 -- 172.21.15.63:0/2537784725 shutdown_connections 2024-09-21T06:59:57.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.160+0000 7fb07d7fa640 1 -- 172.21.15.63:0/2537784725 wait complete. 2024-09-21T06:59:57.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.164+0000 7f9b437fe640 1 -- 172.21.15.63:0/1835857363 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f9b4c012c50 con 0x7f9b5c0733e0 2024-09-21T06:59:57.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.169+0000 7f9b5bfff640 1 -- 172.21.15.63:0/1835857363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b5c0733e0 msgr2=0x7f9b5c158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.169+0000 7f9b5bfff640 1 --2- 172.21.15.63:0/1835857363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b5c0733e0 0x7f9b5c158030 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00c370 tx=0x7f9b4c00c830 comp rx=0 tx=0).stop 2024-09-21T06:59:57.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.173+0000 7f9b5bfff640 1 -- 172.21.15.63:0/1835857363 shutdown_connections 2024-09-21T06:59:57.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.173+0000 7f9b5bfff640 1 --2- 172.21.15.63:0/1835857363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b5c159e80 0x7f9b5c141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.173+0000 7f9b5bfff640 1 --2- 172.21.15.63:0/1835857363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b5c0acf30 0x7f9b5c158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.173+0000 7f9b5bfff640 1 --2- 172.21.15.63:0/1835857363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9b5c0733e0 0x7f9b5c158030 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.173+0000 7f9b5bfff640 1 -- 172.21.15.63:0/1835857363 >> 172.21.15.63:0/1835857363 conn(0x7f9b5c0b1c50 msgr2=0x7f9b5c0cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.180 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi063') 2024-09-21T06:59:57.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.177+0000 7f9b5bfff640 1 -- 172.21.15.63:0/1835857363 shutdown_connections 2024-09-21T06:59:57.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.177+0000 7f9b5bfff640 1 -- 172.21.15.63:0/1835857363 wait complete. 2024-09-21T06:59:57.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.179+0000 7f931bfff640 1 -- 172.21.15.63:0/3122177162 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f9310005580 con 0x7f93301443f0 2024-09-21T06:59:57.183 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi063') 2024-09-21T06:59:57.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.181+0000 7f588debf640 1 -- 172.21.15.63:0/4153599782 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f58880b5d80 con 0x7f58880d0b00 2024-09-21T06:59:57.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.186+0000 7f4fc852b640 1 -- 172.21.15.63:0/2196079743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f4fa8005580 con 0x7f4fb8052390 2024-09-21T06:59:57.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.188+0000 7f93227fc640 1 -- 172.21.15.63:0/3122177162 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v16)=0 v16) ==== 111+0+0 (secure 0 0 0) 0x7f9324003690 con 0x7f93301443f0 2024-09-21T06:59:57.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.190+0000 7f931bfff640 1 -- 172.21.15.63:0/3122177162 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93301443f0 msgr2=0x7f93301e4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.190+0000 7f931bfff640 1 --2- 172.21.15.63:0/3122177162 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93301443f0 0x7f93301e4e50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f932400c430 tx=0x7f932400c8f0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.190+0000 7f931bfff640 1 -- 172.21.15.63:0/3122177162 shutdown_connections 2024-09-21T06:59:57.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.190+0000 7f931bfff640 1 --2- 172.21.15.63:0/3122177162 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f933015ebe0 0x7f933015eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.190+0000 7f931bfff640 1 --2- 172.21.15.63:0/3122177162 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9330144800 0x7f933013ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.190+0000 7f931bfff640 1 --2- 172.21.15.63:0/3122177162 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93301443f0 0x7f93301e4e50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.190+0000 7f931bfff640 1 -- 172.21.15.63:0/3122177162 >> 172.21.15.63:0/3122177162 conn(0x7f93300cd510 msgr2=0x7f9330070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.190+0000 7f931bfff640 1 -- 172.21.15.63:0/3122177162 shutdown_connections 2024-09-21T06:59:57.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.190+0000 7f931bfff640 1 -- 172.21.15.63:0/3122177162 wait complete. 2024-09-21T06:59:57.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.196+0000 7f58857fa640 1 -- 172.21.15.63:0/4153599782 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v17)=0 v17) ==== 119+0+0 (secure 0 0 0) 0x7f587c04a030 con 0x7f58880d0b00 2024-09-21T06:59:57.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.197+0000 7f588debf640 1 -- 172.21.15.63:0/4153599782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58880d0b00 msgr2=0x7f5888071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.198+0000 7f588debf640 1 --2- 172.21.15.63:0/4153599782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58880d0b00 0x7f5888071700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f587c031000 tx=0x7f587c003820 comp rx=0 tx=0).stop 2024-09-21T06:59:57.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.198+0000 7f588debf640 1 -- 172.21.15.63:0/4153599782 shutdown_connections 2024-09-21T06:59:57.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.198+0000 7f588debf640 1 --2- 172.21.15.63:0/4153599782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58880d0b00 0x7f5888071700 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.198+0000 7f588debf640 1 --2- 172.21.15.63:0/4153599782 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f58880af430 0x7f58880711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.198+0000 7f588debf640 1 --2- 172.21.15.63:0/4153599782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f588806cdb0 0x7f588814eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.198+0000 7f588debf640 1 -- 172.21.15.63:0/4153599782 >> 172.21.15.63:0/4153599782 conn(0x7f58880b6580 msgr2=0x7f58880d1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.198+0000 7f588debf640 1 -- 172.21.15.63:0/4153599782 shutdown_connections 2024-09-21T06:59:57.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.198+0000 7f588debf640 1 -- 172.21.15.63:0/4153599782 wait complete. 2024-09-21T06:59:57.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.209+0000 7f4fb6ffd640 1 -- 172.21.15.63:0/2196079743 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v18)=0 v18) ==== 106+0+0 (secure 0 0 0) 0x7f4fc00b79b0 con 0x7f4fb8052390 2024-09-21T06:59:57.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.207+0000 7f2994ff9640 1 -- 172.21.15.63:0/4100275976 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f2984005580 con 0x7f29a00cec90 2024-09-21T06:59:57.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.213+0000 7f4fb4ff9640 1 -- 172.21.15.63:0/2196079743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8052390 msgr2=0x7f4fb804c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.213+0000 7f4fb4ff9640 1 --2- 172.21.15.63:0/2196079743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8052390 0x7f4fb804c8a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4fc006b9c0 tx=0x7f4fc00ac850 comp rx=0 tx=0).stop 2024-09-21T06:59:57.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.213+0000 7f4fb4ff9640 1 -- 172.21.15.63:0/2196079743 shutdown_connections 2024-09-21T06:59:57.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.213+0000 7f4fb4ff9640 1 --2- 172.21.15.63:0/2196079743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4fb8054750 0x7f4fb804cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.213+0000 7f4fb4ff9640 1 --2- 172.21.15.63:0/2196079743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4fb8052390 0x7f4fb804c8a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.213+0000 7f4fb4ff9640 1 --2- 172.21.15.63:0/2196079743 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4fb8051660 0x7f4fb804dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.213+0000 7f4fb4ff9640 1 -- 172.21.15.63:0/2196079743 >> 172.21.15.63:0/2196079743 conn(0x7f4fb801d9d0 msgr2=0x7f4fb8004970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.213+0000 7f4fb4ff9640 1 -- 172.21.15.63:0/2196079743 shutdown_connections 2024-09-21T06:59:57.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.213+0000 7f4fb4ff9640 1 -- 172.21.15.63:0/2196079743 wait complete. 2024-09-21T06:59:57.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.214+0000 7f2996ffd640 1 -- 172.21.15.63:0/4100275976 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v19)=0 v19) ==== 125+0+0 (secure 0 0 0) 0x7f2988012cd0 con 0x7f29a00cec90 2024-09-21T06:59:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.217+0000 7f2994ff9640 1 -- 172.21.15.63:0/4100275976 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f29a00cec90 msgr2=0x7f29a00c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.217+0000 7f2994ff9640 1 --2- 172.21.15.63:0/4100275976 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f29a00cec90 0x7f29a00c6530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f298800c3c0 tx=0x7f298800c880 comp rx=0 tx=0).stop 2024-09-21T06:59:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.218+0000 7f2994ff9640 1 -- 172.21.15.63:0/4100275976 shutdown_connections 2024-09-21T06:59:57.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.218+0000 7f2994ff9640 1 --2- 172.21.15.63:0/4100275976 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f29a00cec90 0x7f29a00c6530 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.218+0000 7f2994ff9640 1 --2- 172.21.15.63:0/4100275976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29a00af410 0x7f29a00c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.218+0000 7f2994ff9640 1 --2- 172.21.15.63:0/4100275976 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29a00710b0 0x7f29a00995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.218+0000 7f2994ff9640 1 -- 172.21.15.63:0/4100275976 >> 172.21.15.63:0/4100275976 conn(0x7f29a006d3e0 msgr2=0x7f29a0155750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.218+0000 7f2994ff9640 1 -- 172.21.15.63:0/4100275976 shutdown_connections 2024-09-21T06:59:57.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.218+0000 7f2994ff9640 1 -- 172.21.15.63:0/4100275976 wait complete. 2024-09-21T06:59:57.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.231+0000 7ff06f24d640 1 -- 172.21.15.63:0/3278946355 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7ff048005580 con 0x7ff0680cd090 2024-09-21T06:59:57.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.236+0000 7f2c26269640 1 -- 172.21.15.63:0/407512340 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f2c00005580 con 0x7f2c20162d80 2024-09-21T06:59:57.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.238+0000 7f209f65c640 1 -- 172.21.15.63:0/2532622579 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f20980b2440 con 0x7f20980b0510 2024-09-21T06:59:57.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.239+0000 7f9a6e7fc640 1 -- 172.21.15.63:0/1583622457 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f9a64005850 con 0x7f9a7c0e0c40 2024-09-21T06:59:57.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.240+0000 7ff0657fa640 1 -- 172.21.15.63:0/3278946355 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v20)=0 v20) ==== 108+0+0 (secure 0 0 0) 0x7ff05c027080 con 0x7ff0680cd090 2024-09-21T06:59:57.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.241+0000 7ff06f24d640 1 -- 172.21.15.63:0/3278946355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0680cd090 msgr2=0x7ff0680b07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.241+0000 7ff06f24d640 1 --2- 172.21.15.63:0/3278946355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0680cd090 0x7ff0680b07c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff05c00f880 tx=0x7ff05c00fd40 comp rx=0 tx=0).stop 2024-09-21T06:59:57.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.241+0000 7ff06f24d640 1 -- 172.21.15.63:0/3278946355 shutdown_connections 2024-09-21T06:59:57.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.241+0000 7ff06f24d640 1 --2- 172.21.15.63:0/3278946355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0680cd090 0x7ff0680b07c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.241+0000 7ff06f24d640 1 --2- 172.21.15.63:0/3278946355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0680ccc80 0x7ff068214d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.241+0000 7ff06f24d640 1 --2- 172.21.15.63:0/3278946355 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff0680cc270 0x7ff0680ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.241+0000 7ff06f24d640 1 -- 172.21.15.63:0/3278946355 >> 172.21.15.63:0/3278946355 conn(0x7ff0680b1d50 msgr2=0x7ff0680b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.241+0000 7ff06f24d640 1 -- 172.21.15.63:0/3278946355 shutdown_connections 2024-09-21T06:59:57.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.242+0000 7ff06f24d640 1 -- 172.21.15.63:0/3278946355 wait complete. 2024-09-21T06:59:57.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.243+0000 7f2c1cff9640 1 -- 172.21.15.63:0/407512340 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f2c10019bd0 con 0x7f2c20162d80 2024-09-21T06:59:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.245+0000 7f2c26269640 1 -- 172.21.15.63:0/407512340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c20162d80 msgr2=0x7f2c20160e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.245+0000 7f2c26269640 1 --2- 172.21.15.63:0/407512340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c20162d80 0x7f2c20160e70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000b410 tx=0x7f2c1000b810 comp rx=0 tx=0).stop 2024-09-21T06:59:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.245+0000 7f2c26269640 1 -- 172.21.15.63:0/407512340 shutdown_connections 2024-09-21T06:59:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.245+0000 7f2c26269640 1 --2- 172.21.15.63:0/407512340 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2c20162d80 0x7f2c20160e70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.245+0000 7f2c26269640 1 --2- 172.21.15.63:0/407512340 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2c200ccc80 0x7f2c20160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.245+0000 7f2c26269640 1 --2- 172.21.15.63:0/407512340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c200ad030 0x7f2c20098eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.245+0000 7f2c26269640 1 -- 172.21.15.63:0/407512340 >> 172.21.15.63:0/407512340 conn(0x7f2c200b1d50 msgr2=0x7f2c2006f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.245+0000 7f2c26269640 1 -- 172.21.15.63:0/407512340 shutdown_connections 2024-09-21T06:59:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.245+0000 7f2c26269640 1 -- 172.21.15.63:0/407512340 wait complete. 2024-09-21T06:59:57.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.247+0000 7f2095ffb640 1 -- 172.21.15.63:0/2532622579 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v22)=0 v22) ==== 120+0+0 (secure 0 0 0) 0x7f208c005500 con 0x7f20980b0510 2024-09-21T06:59:57.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.248+0000 7f209f65c640 1 -- 172.21.15.63:0/2532622579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20980b0510 msgr2=0x7f20980b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.248+0000 7f209f65c640 1 --2- 172.21.15.63:0/2532622579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20980b0510 0x7f20980b4710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f208c009850 tx=0x7f208c004e20 comp rx=0 tx=0).stop 2024-09-21T06:59:57.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.248+0000 7f209f65c640 1 -- 172.21.15.63:0/2532622579 shutdown_connections 2024-09-21T06:59:57.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.248+0000 7f209f65c640 1 --2- 172.21.15.63:0/2532622579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20980ccc80 0x7f20980c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.248+0000 7f209f65c640 1 --2- 172.21.15.63:0/2532622579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f20980b0510 0x7f20980b4710 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.248+0000 7f209f65c640 1 --2- 172.21.15.63:0/2532622579 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20980afbc0 0x7f20980b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.248+0000 7f209f65c640 1 -- 172.21.15.63:0/2532622579 >> 172.21.15.63:0/2532622579 conn(0x7f20980b1d50 msgr2=0x7f2098162630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.249+0000 7f209f65c640 1 -- 172.21.15.63:0/2532622579 shutdown_connections 2024-09-21T06:59:57.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.249+0000 7f209f65c640 1 -- 172.21.15.63:0/2532622579 wait complete. 2024-09-21T06:59:57.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.251+0000 7f9a80ff9640 1 -- 172.21.15.63:0/1583622457 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f9a84095ce0 con 0x7f9a7c0e0c40 2024-09-21T06:59:57.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.253+0000 7f9a6e7fc640 1 -- 172.21.15.63:0/1583622457 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a7c0e0c40 msgr2=0x7f9a7c0ddce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.253+0000 7f9a6e7fc640 1 --2- 172.21.15.63:0/1583622457 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a7c0e0c40 0x7f9a7c0ddce0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9a8406c290 tx=0x7f9a840724b0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.253+0000 7f9a6e7fc640 1 -- 172.21.15.63:0/1583622457 shutdown_connections 2024-09-21T06:59:57.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.253+0000 7f9a6e7fc640 1 --2- 172.21.15.63:0/1583622457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a7c0de220 0x7f9a7c0de630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.253+0000 7f9a6e7fc640 1 --2- 172.21.15.63:0/1583622457 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f9a7c0e0c40 0x7f9a7c0ddce0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.253+0000 7f9a6e7fc640 1 --2- 172.21.15.63:0/1583622457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a7c057590 0x7f9a7c186060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.253+0000 7f9a6e7fc640 1 -- 172.21.15.63:0/1583622457 >> 172.21.15.63:0/1583622457 conn(0x7f9a7c055ea0 msgr2=0x7f9a7c053100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.253+0000 7f9a6e7fc640 1 -- 172.21.15.63:0/1583622457 shutdown_connections 2024-09-21T06:59:57.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.253+0000 7f9a6e7fc640 1 -- 172.21.15.63:0/1583622457 wait complete. 2024-09-21T06:59:57.271 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi063') 2024-09-21T06:59:57.272 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi063') 2024-09-21T06:59:57.272 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi063') 2024-09-21T06:59:57.272 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi063') 2024-09-21T06:59:57.272 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi063') 2024-09-21T06:59:57.272 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi063') 2024-09-21T06:59:57.272 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi063') 2024-09-21T06:59:57.272 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi063') 2024-09-21T06:59:57.272 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config dump 2024-09-21T06:59:57.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.422+0000 7f5510a4d640 1 -- 172.21.15.63:0/3313080535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f550c165e80 msgr2=0x7f550c1682a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.422+0000 7f5510a4d640 1 --2- 172.21.15.63:0/3313080535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f550c165e80 0x7f550c1682a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5504005fd0 tx=0x7f550402aaa0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.422+0000 7f5510a4d640 1 -- 172.21.15.63:0/3313080535 shutdown_connections 2024-09-21T06:59:57.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.422+0000 7f5510a4d640 1 --2- 172.21.15.63:0/3313080535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f550c165e80 0x7f550c1682a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.422+0000 7f5510a4d640 1 -- 172.21.15.63:0/3313080535 >> 172.21.15.63:0/3313080535 conn(0x7f550c0ceed0 msgr2=0x7f550c0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.422+0000 7f5510a4d640 1 -- 172.21.15.63:0/3313080535 shutdown_connections 2024-09-21T06:59:57.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.422+0000 7f5510a4d640 1 -- 172.21.15.63:0/3313080535 wait complete. 2024-09-21T06:59:57.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.424+0000 7f5510a4d640 1 Processor -- start 2024-09-21T06:59:57.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.424+0000 7f5510a4d640 1 -- start start 2024-09-21T06:59:57.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.425+0000 7f5510a4d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c0b52a0 0x7f550c1f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.425+0000 7f5510a4d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f550c0d0350 0x7f550c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.425+0000 7f5510a4d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f550c165e80 0x7f550c164f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.425+0000 7f5510a4d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f550c0d0760 con 0x7f550c165e80 2024-09-21T06:59:57.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.425+0000 7f5510a4d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f550c0d1400 con 0x7f550c0b52a0 2024-09-21T06:59:57.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.425+0000 7f5510a4d640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f550c0b8280 con 0x7f550c0d0350 2024-09-21T06:59:57.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f550ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f550c165e80 0x7f550c164f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f550a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c0b52a0 0x7f550c1f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f550ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f550c165e80 0x7f550c164f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44778/0 (socket says 172.21.15.63:44778) 2024-09-21T06:59:57.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f5509d9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f550c0d0350 0x7f550c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f550ad9d640 1 -- 172.21.15.63:0/132983972 learned_addr learned my addr 172.21.15.63:0/132983972 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:57.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f550ad9d640 1 -- 172.21.15.63:0/132983972 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f550c0d0350 msgr2=0x7f550c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f550ad9d640 1 --2- 172.21.15.63:0/132983972 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f550c0d0350 0x7f550c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f550ad9d640 1 -- 172.21.15.63:0/132983972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c0b52a0 msgr2=0x7f550c1f9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f550ad9d640 1 --2- 172.21.15.63:0/132983972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c0b52a0 0x7f550c1f9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f550ad9d640 1 -- 172.21.15.63:0/132983972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c1fa3a0 con 0x7f550c165e80 2024-09-21T06:59:57.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f550ad9d640 1 --2- 172.21.15.63:0/132983972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f550c165e80 0x7f550c164f00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5504006010 tx=0x7f5504003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:57.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f54faffd640 1 -- 172.21.15.63:0/132983972 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504044070 con 0x7f550c165e80 2024-09-21T06:59:57.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f54faffd640 1 -- 172.21.15.63:0/132983972 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5504004250 con 0x7f550c165e80 2024-09-21T06:59:57.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f54faffd640 1 -- 172.21.15.63:0/132983972 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504004680 con 0x7f550c165e80 2024-09-21T06:59:57.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f5510a4d640 1 -- 172.21.15.63:0/132983972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550c1f6280 con 0x7f550c165e80 2024-09-21T06:59:57.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.426+0000 7f5510a4d640 1 -- 172.21.15.63:0/132983972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550c1f6840 con 0x7f550c165e80 2024-09-21T06:59:57.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.427+0000 7f54faffd640 1 -- 172.21.15.63:0/132983972 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5504047070 con 0x7f550c165e80 2024-09-21T06:59:57.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.427+0000 7f54faffd640 1 -- 172.21.15.63:0/132983972 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5504049ca0 con 0x7f550c165e80 2024-09-21T06:59:57.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.427+0000 7f5510a4d640 1 -- 172.21.15.63:0/132983972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f550c1f5ff0 con 0x7f550c165e80 2024-09-21T06:59:57.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.429+0000 7f54faffd640 1 -- 172.21.15.63:0/132983972 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f550404e080 con 0x7f550c165e80 2024-09-21T06:59:57.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.492+0000 7f5510a4d640 1 -- 172.21.15.63:0/132983972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f550c0b3cb0 con 0x7f550c165e80 2024-09-21T06:59:57.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.493+0000 7f54faffd640 1 -- 172.21.15.63:0/132983972 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7f550c0b3cb0 con 0x7f550c165e80 2024-09-21T06:59:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:59:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:59:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:59:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_client 20/20 2024-09-21T06:59:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:59:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:59:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:59:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:59:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_mds 20/20 2024-09-21T06:59:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:59:57.496 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_ms 2/2 2024-09-21T06:59:57.497 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_debug_frag true 2024-09-21T06:59:57.497 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:59:57.497 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:59:57.497 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_verify_scatter true 2024-09-21T06:59:57.497 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:59:57.497 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:59:57.497 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:59:57.497 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced client_mount_timeout 600 2024-09-21T06:59:57.497 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced debug_client 20/20 2024-09-21T06:59:57.497 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced debug_ms 1/1 2024-09-21T06:59:57.497 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:59:57.497 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:59:57.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.493+0000 7f5510a4d640 1 -- 172.21.15.63:0/132983972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f550c165e80 msgr2=0x7f550c164f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.493+0000 7f5510a4d640 1 --2- 172.21.15.63:0/132983972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f550c165e80 0x7f550c164f00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5504006010 tx=0x7f5504003f10 comp rx=0 tx=0).stop 2024-09-21T06:59:57.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.493+0000 7f5510a4d640 1 -- 172.21.15.63:0/132983972 shutdown_connections 2024-09-21T06:59:57.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.493+0000 7f5510a4d640 1 --2- 172.21.15.63:0/132983972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f550c165e80 0x7f550c164f00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.493+0000 7f5510a4d640 1 --2- 172.21.15.63:0/132983972 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f550c0d0350 0x7f550c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.493+0000 7f5510a4d640 1 --2- 172.21.15.63:0/132983972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550c0b52a0 0x7f550c1f9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.494+0000 7f5510a4d640 1 -- 172.21.15.63:0/132983972 >> 172.21.15.63:0/132983972 conn(0x7f550c0ceed0 msgr2=0x7f550c15c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.494+0000 7f5510a4d640 1 -- 172.21.15.63:0/132983972 shutdown_connections 2024-09-21T06:59:57.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.494+0000 7f5510a4d640 1 -- 172.21.15.63:0/132983972 wait complete. 2024-09-21T06:59:57.507 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T06:59:57.508 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T06:59:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.621+0000 7f82a4512640 1 -- 172.21.15.63:0/4144956703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c0b6c10 msgr2=0x7f829c0ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.621+0000 7f82a4512640 1 --2- 172.21.15.63:0/4144956703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c0b6c10 0x7f829c0ce2a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f829c0725b0 tx=0x7f829002a4d0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.621+0000 7f82a4512640 1 -- 172.21.15.63:0/4144956703 shutdown_connections 2024-09-21T06:59:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.621+0000 7f82a4512640 1 --2- 172.21.15.63:0/4144956703 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c0b6c10 0x7f829c0ce2a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.621+0000 7f82a4512640 1 --2- 172.21.15.63:0/4144956703 >> v2:172.21.15.71:3300/0 conn(0x7f829c0b0910 0x7f829c0cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.621+0000 7f82a4512640 1 -- 172.21.15.63:0/4144956703 >> 172.21.15.63:0/4144956703 conn(0x7f829c0b6800 msgr2=0x7f829c0b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.621+0000 7f82a4512640 1 -- 172.21.15.63:0/4144956703 shutdown_connections 2024-09-21T06:59:57.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.621+0000 7f82a4512640 1 -- 172.21.15.63:0/4144956703 wait complete. 2024-09-21T06:59:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.623+0000 7f82a4512640 1 Processor -- start 2024-09-21T06:59:57.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.623+0000 7f82a4512640 1 -- start start 2024-09-21T06:59:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.624+0000 7f82a4512640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c0b0910 0x7f829c148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.624+0000 7f82a4512640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f829c0b6c10 0x7f829c1f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.624+0000 7f82a4512640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f829c0ce7e0 0x7f829c157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.624+0000 7f82a4512640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f829c0b5580 con 0x7f829c0b0910 2024-09-21T06:59:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.624+0000 7f82a4512640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f829c0b5400 con 0x7f829c0b6c10 2024-09-21T06:59:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.624+0000 7f82a4512640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f829c0b5700 con 0x7f829c0ce7e0 2024-09-21T06:59:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.624+0000 7f82a22ae640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c0b0910 0x7f829c148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.624+0000 7f82a22ae640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c0b0910 0x7f829c148610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44790/0 (socket says 172.21.15.63:44790) 2024-09-21T06:59:57.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.624+0000 7f82a22ae640 1 -- 172.21.15.63:0/3791469124 learned_addr learned my addr 172.21.15.63:0/3791469124 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.624+0000 7f82a1aad640 1 --2- 172.21.15.63:0/3791469124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f829c0b6c10 0x7f829c1f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.624+0000 7f82a2aaf640 1 --2- 172.21.15.63:0/3791469124 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f829c0ce7e0 0x7f829c157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.625+0000 7f82a22ae640 1 -- 172.21.15.63:0/3791469124 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f829c0ce7e0 msgr2=0x7f829c157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.625+0000 7f82a22ae640 1 --2- 172.21.15.63:0/3791469124 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f829c0ce7e0 0x7f829c157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.625+0000 7f82a22ae640 1 -- 172.21.15.63:0/3791469124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f829c0b6c10 msgr2=0x7f829c1f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.625+0000 7f82a22ae640 1 --2- 172.21.15.63:0/3791469124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f829c0b6c10 0x7f829c1f72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.625+0000 7f82a22ae640 1 -- 172.21.15.63:0/3791469124 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c1562c0 con 0x7f829c0b0910 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.625+0000 7f82a22ae640 1 --2- 172.21.15.63:0/3791469124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c0b0910 0x7f829c148610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f829800e7c0 tx=0x7f829800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.625+0000 7f828effd640 1 -- 172.21.15.63:0/3791469124 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829800ccc0 con 0x7f829c0b0910 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.625+0000 7f828effd640 1 -- 172.21.15.63:0/3791469124 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8298010430 con 0x7f829c0b0910 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.625+0000 7f82a4512640 1 -- 172.21.15.63:0/3791469124 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829c1565a0 con 0x7f829c0b0910 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.625+0000 7f828effd640 1 -- 172.21.15.63:0/3791469124 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8298010860 con 0x7f829c0b0910 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.625+0000 7f82a4512640 1 -- 172.21.15.63:0/3791469124 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829c156b60 con 0x7f829c0b0910 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.625+0000 7f828effd640 1 -- 172.21.15.63:0/3791469124 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8298010a00 con 0x7f829c0b0910 2024-09-21T06:59:57.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.625+0000 7f828effd640 1 -- 172.21.15.63:0/3791469124 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8298018d20 con 0x7f829c0b0910 2024-09-21T06:59:57.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.626+0000 7f82a4512640 1 -- 172.21.15.63:0/3791469124 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829c0b4cf0 con 0x7f829c0b0910 2024-09-21T06:59:57.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.628+0000 7f828effd640 1 -- 172.21.15.63:0/3791469124 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8298018420 con 0x7f829c0b0910 2024-09-21T06:59:57.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.694+0000 7f82a4512640 1 -- 172.21.15.63:0/3791469124 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f829c15b470 con 0x7f829c0b0910 2024-09-21T06:59:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.696+0000 7f828effd640 1 -- 172.21.15.63:0/3791469124 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f8298018600 con 0x7f829c0b0910 2024-09-21T06:59:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2024-09-21T06:59:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.697+0000 7f82a4512640 1 -- 172.21.15.63:0/3791469124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c0b0910 msgr2=0x7f829c148610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.697+0000 7f82a4512640 1 --2- 172.21.15.63:0/3791469124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c0b0910 0x7f829c148610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f829800e7c0 tx=0x7f829800ec80 comp rx=0 tx=0).stop 2024-09-21T06:59:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.697+0000 7f82a4512640 1 -- 172.21.15.63:0/3791469124 shutdown_connections 2024-09-21T06:59:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.697+0000 7f82a4512640 1 --2- 172.21.15.63:0/3791469124 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f829c0ce7e0 0x7f829c157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.697+0000 7f82a4512640 1 --2- 172.21.15.63:0/3791469124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f829c0b6c10 0x7f829c1f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.697+0000 7f82a4512640 1 --2- 172.21.15.63:0/3791469124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f829c0b0910 0x7f829c148610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.697+0000 7f82a4512640 1 -- 172.21.15.63:0/3791469124 >> 172.21.15.63:0/3791469124 conn(0x7f829c0b6800 msgr2=0x7f829c0718a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.697+0000 7f82a4512640 1 -- 172.21.15.63:0/3791469124 shutdown_connections 2024-09-21T06:59:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T06:59:57.697+0000 7f82a4512640 1 -- 172.21.15.63:0/3791469124 wait complete. 2024-09-21T06:59:57.710 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T06:59:57.711 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T06:59:57.711 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:57.711 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T06:59:57.736 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:57.736 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T06:59:57.802 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:57.802 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T06:59:57.868 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T06:59:57.868 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T06:59:57.933 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:57.933 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-21T06:59:57.958 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:57.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-21T06:59:58.024 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:58.024 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-21T06:59:58.088 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T06:59:58.089 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-21T06:59:58.153 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 1b840b5c-68b1-49fe-8a51-63ae216acff4 0 2024-09-21T06:59:58.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.305+0000 7fda86ec5640 1 -- 172.21.15.71:0/844448812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda800b4350 msgr2=0x7fda80159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.305+0000 7fda86ec5640 1 --2- 172.21.15.71:0/844448812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda800b4350 0x7fda80159300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fda74009830 tx=0x7fda7402a510 comp rx=0 tx=0).stop 2024-09-21T06:59:58.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.305+0000 7fda86ec5640 1 -- 172.21.15.71:0/844448812 shutdown_connections 2024-09-21T06:59:58.307 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.305+0000 7fda86ec5640 1 --2- 172.21.15.71:0/844448812 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fda800b3d30 0x7fda800af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.305+0000 7fda86ec5640 1 --2- 172.21.15.71:0/844448812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda800b4350 0x7fda80159300 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.305+0000 7fda86ec5640 1 -- 172.21.15.71:0/844448812 >> 172.21.15.71:0/844448812 conn(0x7fda8009aa40 msgr2=0x7fda800b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:58.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.305+0000 7fda86ec5640 1 -- 172.21.15.71:0/844448812 shutdown_connections 2024-09-21T06:59:58.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.305+0000 7fda86ec5640 1 -- 172.21.15.71:0/844448812 wait complete. 2024-09-21T06:59:58.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.307+0000 7fda86ec5640 1 Processor -- start 2024-09-21T06:59:58.308 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.307+0000 7fda86ec5640 1 -- start start 2024-09-21T06:59:58.311 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.308+0000 7fda86ec5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda800b3920 0x7fda8014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.308+0000 7fda86ec5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda800b3d30 0x7fda80141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.308+0000 7fda86ec5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fda800b4350 0x7fda801f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.308+0000 7fda86ec5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fda800afa80 con 0x7fda800b3d30 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.308+0000 7fda86ec5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fda800af900 con 0x7fda800b3920 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.308+0000 7fda86ec5640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fda800afc00 con 0x7fda800b4350 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda84c61640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda800b3920 0x7fda8014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda85462640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fda800b4350 0x7fda801f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda84c61640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda800b3920 0x7fda8014efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44250/0 (socket says 172.21.15.71:44250) 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda84c61640 1 -- 172.21.15.71:0/1815920447 learned_addr learned my addr 172.21.15.71:0/1815920447 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda7ffff640 1 --2- 172.21.15.71:0/1815920447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda800b3d30 0x7fda80141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda85462640 1 -- 172.21.15.71:0/1815920447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda800b3920 msgr2=0x7fda8014efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda85462640 1 --2- 172.21.15.71:0/1815920447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda800b3920 0x7fda8014efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda85462640 1 -- 172.21.15.71:0/1815920447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda800b3d30 msgr2=0x7fda80141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.312 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda85462640 1 --2- 172.21.15.71:0/1815920447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda800b3d30 0x7fda80141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda85462640 1 -- 172.21.15.71:0/1815920447 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda80142340 con 0x7fda800b4350 2024-09-21T06:59:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda84c61640 1 --2- 172.21.15.71:0/1815920447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda800b3920 0x7fda8014efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:59:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda7ffff640 1 --2- 172.21.15.71:0/1815920447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda800b3d30 0x7fda80141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:59:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda85462640 1 --2- 172.21.15.71:0/1815920447 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fda800b4350 0x7fda801f2d10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fda78005fd0 tx=0x7fda7800c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda7d7fa640 1 -- 172.21.15.71:0/1815920447 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78003970 con 0x7fda800b4350 2024-09-21T06:59:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda7d7fa640 1 -- 172.21.15.71:0/1815920447 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda78003c20 con 0x7fda800b4350 2024-09-21T06:59:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda86ec5640 1 -- 172.21.15.71:0/1815920447 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda801f3a70 con 0x7fda800b4350 2024-09-21T06:59:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda7d7fa640 1 -- 172.21.15.71:0/1815920447 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78004280 con 0x7fda800b4350 2024-09-21T06:59:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.309+0000 7fda86ec5640 1 -- 172.21.15.71:0/1815920447 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fda8015d420 con 0x7fda800b4350 2024-09-21T06:59:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.310+0000 7fda7d7fa640 1 -- 172.21.15.71:0/1815920447 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fda78004b40 con 0x7fda800b4350 2024-09-21T06:59:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.310+0000 7fda7d7fa640 1 -- 172.21.15.71:0/1815920447 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fda7800b920 con 0x7fda800b4350 2024-09-21T06:59:58.313 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.310+0000 7fda86ec5640 1 -- 172.21.15.71:0/1815920447 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda801f37e0 con 0x7fda800b4350 2024-09-21T06:59:58.314 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.312+0000 7fda7d7fa640 1 -- 172.21.15.71:0/1815920447 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fda78024070 con 0x7fda800b4350 2024-09-21T06:59:58.385 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.383+0000 7fda86ec5640 1 -- 172.21.15.71:0/1815920447 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1b840b5c-68b1-49fe-8a51-63ae216acff4", "id": 0} v 0) -- 0x7fda8015cf30 con 0x7fda800b4350 2024-09-21T06:59:58.391 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.390+0000 7fda7d7fa640 1 -- 172.21.15.71:0/1815920447 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b840b5c-68b1-49fe-8a51-63ae216acff4", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fda78003e10 con 0x7fda800b4350 2024-09-21T06:59:58.392 INFO:teuthology.orchestra.run.smithi071.stdout:0 2024-09-21T06:59:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.391+0000 7fda86ec5640 1 -- 172.21.15.71:0/1815920447 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fda800b4350 msgr2=0x7fda801f2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.391+0000 7fda86ec5640 1 --2- 172.21.15.71:0/1815920447 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fda800b4350 0x7fda801f2d10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fda78005fd0 tx=0x7fda7800c740 comp rx=0 tx=0).stop 2024-09-21T06:59:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.391+0000 7fda86ec5640 1 -- 172.21.15.71:0/1815920447 shutdown_connections 2024-09-21T06:59:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.391+0000 7fda86ec5640 1 --2- 172.21.15.71:0/1815920447 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fda800b4350 0x7fda801f2d10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.391+0000 7fda86ec5640 1 --2- 172.21.15.71:0/1815920447 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda800b3d30 0x7fda80141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.391+0000 7fda86ec5640 1 --2- 172.21.15.71:0/1815920447 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda800b3920 0x7fda8014efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.391+0000 7fda86ec5640 1 -- 172.21.15.71:0/1815920447 >> 172.21.15.71:0/1815920447 conn(0x7fda8009aa40 msgr2=0x7fda80155080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.391+0000 7fda86ec5640 1 -- 172.21.15.71:0/1815920447 shutdown_connections 2024-09-21T06:59:58.393 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.391+0000 7fda86ec5640 1 -- 172.21.15.71:0/1815920447 wait complete. 2024-09-21T06:59:58.403 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 3357f178-f274-4168-b56e-cbb55bfcb183 1 2024-09-21T06:59:58.515 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.513+0000 7f200f62e640 1 -- 172.21.15.71:0/3765099257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f200815f930 msgr2=0x7f20080af120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.513+0000 7f200f62e640 1 --2- 172.21.15.71:0/3765099257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f200815f930 0x7f20080af120 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f20080b3000 tx=0x7f200002aa30 comp rx=0 tx=0).stop 2024-09-21T06:59:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.514+0000 7f200f62e640 1 -- 172.21.15.71:0/3765099257 shutdown_connections 2024-09-21T06:59:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.514+0000 7f200f62e640 1 --2- 172.21.15.71:0/3765099257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f200815f930 0x7f20080af120 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.514+0000 7f200f62e640 1 --2- 172.21.15.71:0/3765099257 >> v2:172.21.15.63:3300/0 conn(0x7f2008159300 0x7f200815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.514+0000 7f200f62e640 1 -- 172.21.15.71:0/3765099257 >> 172.21.15.71:0/3765099257 conn(0x7f200809aa40 msgr2=0x7f20080b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.514+0000 7f200f62e640 1 -- 172.21.15.71:0/3765099257 shutdown_connections 2024-09-21T06:59:58.516 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.514+0000 7f200f62e640 1 -- 172.21.15.71:0/3765099257 wait complete. 2024-09-21T06:59:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.515+0000 7f200f62e640 1 Processor -- start 2024-09-21T06:59:58.517 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.515+0000 7f200f62e640 1 -- start start 2024-09-21T06:59:58.519 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200f62e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20080b4350 0x7f200814e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200f62e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2008159300 0x7f200815e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200f62e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f200815f930 0x7f20081419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200f62e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f20080afad0 con 0x7f2008159300 2024-09-21T06:59:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200f62e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f20080af950 con 0x7f200815f930 2024-09-21T06:59:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200f62e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f20080afc50 con 0x7f20080b4350 2024-09-21T06:59:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200dbcb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f200815f930 0x7f20081419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200d3ca640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20080b4350 0x7f200814e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200dbcb640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f200815f930 0x7f20081419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44270/0 (socket says 172.21.15.71:44270) 2024-09-21T06:59:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200dbcb640 1 -- 172.21.15.71:0/342188472 learned_addr learned my addr 172.21.15.71:0/342188472 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-21T06:59:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200cbc9640 1 --2- 172.21.15.71:0/342188472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2008159300 0x7f200815e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200dbcb640 1 -- 172.21.15.71:0/342188472 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20080b4350 msgr2=0x7f200814e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200dbcb640 1 --2- 172.21.15.71:0/342188472 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20080b4350 0x7f200814e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.520 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200dbcb640 1 -- 172.21.15.71:0/342188472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2008159300 msgr2=0x7f200815e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200dbcb640 1 --2- 172.21.15.71:0/342188472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2008159300 0x7f200815e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200dbcb640 1 -- 172.21.15.71:0/342188472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20081f3300 con 0x7f200815f930 2024-09-21T06:59:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f200dbcb640 1 --2- 172.21.15.71:0/342188472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f200815f930 0x7f20081419f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f200002b020 tx=0x7f2000003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.517+0000 7f1ffdffb640 1 -- 172.21.15.71:0/342188472 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000043020 con 0x7f200815f930 2024-09-21T06:59:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.518+0000 7f1ffdffb640 1 -- 172.21.15.71:0/342188472 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2000004540 con 0x7f200815f930 2024-09-21T06:59:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.518+0000 7f200f62e640 1 -- 172.21.15.71:0/342188472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20081f2a60 con 0x7f200815f930 2024-09-21T06:59:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.518+0000 7f1ffdffb640 1 -- 172.21.15.71:0/342188472 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000033070 con 0x7f200815f930 2024-09-21T06:59:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.518+0000 7f200f62e640 1 -- 172.21.15.71:0/342188472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20081f3020 con 0x7f200815f930 2024-09-21T06:59:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.518+0000 7f1ffdffb640 1 -- 172.21.15.71:0/342188472 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2000046020 con 0x7f200815f930 2024-09-21T06:59:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.518+0000 7f1ffdffb640 1 -- 172.21.15.71:0/342188472 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f20000487b0 con 0x7f200815f930 2024-09-21T06:59:58.521 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.519+0000 7f200f62e640 1 -- 172.21.15.71:0/342188472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20080b0100 con 0x7f200815f930 2024-09-21T06:59:58.522 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.521+0000 7f1ffdffb640 1 -- 172.21.15.71:0/342188472 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f200004d020 con 0x7f200815f930 2024-09-21T06:59:58.592 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.590+0000 7f200f62e640 1 -- 172.21.15.71:0/342188472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3357f178-f274-4168-b56e-cbb55bfcb183", "id": 1} v 0) -- 0x7f200815f440 con 0x7f200815f930 2024-09-21T06:59:58.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.594+0000 7f1ffdffb640 1 -- 172.21.15.71:0/342188472 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3357f178-f274-4168-b56e-cbb55bfcb183", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f2000048a00 con 0x7f200815f930 2024-09-21T06:59:58.595 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-09-21T06:59:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.595+0000 7f200f62e640 1 -- 172.21.15.71:0/342188472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f200815f930 msgr2=0x7f20081419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.595+0000 7f200f62e640 1 --2- 172.21.15.71:0/342188472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f200815f930 0x7f20081419f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f200002b020 tx=0x7f2000003f10 comp rx=0 tx=0).stop 2024-09-21T06:59:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.595+0000 7f200f62e640 1 -- 172.21.15.71:0/342188472 shutdown_connections 2024-09-21T06:59:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.595+0000 7f200f62e640 1 --2- 172.21.15.71:0/342188472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f200815f930 0x7f20081419f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.595+0000 7f200f62e640 1 --2- 172.21.15.71:0/342188472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2008159300 0x7f200815e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.595+0000 7f200f62e640 1 --2- 172.21.15.71:0/342188472 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f20080b4350 0x7f200814e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.595+0000 7f200f62e640 1 -- 172.21.15.71:0/342188472 >> 172.21.15.71:0/342188472 conn(0x7f200809aa40 msgr2=0x7f2008156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.595+0000 7f200f62e640 1 -- 172.21.15.71:0/342188472 shutdown_connections 2024-09-21T06:59:58.597 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.595+0000 7f200f62e640 1 -- 172.21.15.71:0/342188472 wait complete. 2024-09-21T06:59:58.607 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 50da4810-f26a-476b-b74c-d4c9a84ddb20 2 2024-09-21T06:59:58.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.718+0000 7f10b1a64640 1 -- 172.21.15.71:0/2782724661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10ac159300 msgr2=0x7f10ac15f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.718+0000 7f10b1a64640 1 --2- 172.21.15.71:0/2782724661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10ac159300 0x7f10ac15f3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f109c009830 tx=0x7f109c02a530 comp rx=0 tx=0).stop 2024-09-21T06:59:58.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.718+0000 7f10b1a64640 1 -- 172.21.15.71:0/2782724661 shutdown_connections 2024-09-21T06:59:58.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.718+0000 7f10b1a64640 1 --2- 172.21.15.71:0/2782724661 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10ac159300 0x7f10ac15f3f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.718+0000 7f10b1a64640 1 -- 172.21.15.71:0/2782724661 >> 172.21.15.71:0/2782724661 conn(0x7f10ac09aa40 msgr2=0x7f10ac0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:58.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.718+0000 7f10b1a64640 1 -- 172.21.15.71:0/2782724661 shutdown_connections 2024-09-21T06:59:58.720 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.718+0000 7f10b1a64640 1 -- 172.21.15.71:0/2782724661 wait complete. 2024-09-21T06:59:58.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.720+0000 7f10b1a64640 1 Processor -- start 2024-09-21T06:59:58.721 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.720+0000 7f10b1a64640 1 -- start start 2024-09-21T06:59:58.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.721+0000 7f10b1a64640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10ac0b4350 0x7f10ac14eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:58.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.721+0000 7f10b1a64640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10ac159300 0x7f10ac070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:58.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.721+0000 7f10b1a64640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10ac15f930 0x7f10ac0713f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:58.724 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.721+0000 7f10b1a64640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac0afcb0 con 0x7f10ac15f930 2024-09-21T06:59:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.721+0000 7f10b1a64640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac0afb30 con 0x7f10ac159300 2024-09-21T06:59:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.721+0000 7f10b1a64640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f10ac0afe30 con 0x7f10ac0b4350 2024-09-21T06:59:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.721+0000 7f10ab7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10ac0b4350 0x7f10ac14eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.721+0000 7f10aaffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10ac159300 0x7f10ac070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.721+0000 7f10ab7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10ac0b4350 0x7f10ac14eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:35070/0 (socket says 172.21.15.71:35070) 2024-09-21T06:59:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.721+0000 7f10aaffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10ac159300 0x7f10ac070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44292/0 (socket says 172.21.15.71:44292) 2024-09-21T06:59:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.721+0000 7f10ab7fe640 1 -- 172.21.15.71:0/3267047799 learned_addr learned my addr 172.21.15.71:0/3267047799 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-21T06:59:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.721+0000 7f10abfff640 1 --2- 172.21.15.71:0/3267047799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10ac15f930 0x7f10ac0713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.722+0000 7f10ab7fe640 1 -- 172.21.15.71:0/3267047799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10ac159300 msgr2=0x7f10ac070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.722+0000 7f10ab7fe640 1 --2- 172.21.15.71:0/3267047799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10ac159300 0x7f10ac070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.722+0000 7f10ab7fe640 1 -- 172.21.15.71:0/3267047799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10ac15f930 msgr2=0x7f10ac0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.722+0000 7f10ab7fe640 1 --2- 172.21.15.71:0/3267047799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10ac15f930 0x7f10ac0713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.722+0000 7f10ab7fe640 1 -- 172.21.15.71:0/3267047799 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ac14d5d0 con 0x7f10ac0b4350 2024-09-21T06:59:58.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.722+0000 7f10ab7fe640 1 --2- 172.21.15.71:0/3267047799 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10ac0b4350 0x7f10ac14eb10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f10a000c3a0 tx=0x7f10a000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:58.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.722+0000 7f1093fff640 1 -- 172.21.15.71:0/3267047799 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0017070 con 0x7f10ac0b4350 2024-09-21T06:59:58.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.722+0000 7f1093fff640 1 -- 172.21.15.71:0/3267047799 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10a00053c0 con 0x7f10ac0b4350 2024-09-21T06:59:58.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.722+0000 7f10b1a64640 1 -- 172.21.15.71:0/3267047799 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ac14f680 con 0x7f10ac0b4350 2024-09-21T06:59:58.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.722+0000 7f1093fff640 1 -- 172.21.15.71:0/3267047799 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0003850 con 0x7f10ac0b4350 2024-09-21T06:59:58.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.722+0000 7f10b1a64640 1 -- 172.21.15.71:0/3267047799 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ac14fc40 con 0x7f10ac0b4350 2024-09-21T06:59:58.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.722+0000 7f1093fff640 1 -- 172.21.15.71:0/3267047799 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f10a001a070 con 0x7f10ac0b4350 2024-09-21T06:59:58.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.722+0000 7f1093fff640 1 -- 172.21.15.71:0/3267047799 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f10a0011c20 con 0x7f10ac0b4350 2024-09-21T06:59:58.726 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.723+0000 7f10b1a64640 1 -- 172.21.15.71:0/3267047799 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10ac0b02e0 con 0x7f10ac0b4350 2024-09-21T06:59:58.727 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.725+0000 7f1093fff640 1 -- 172.21.15.71:0/3267047799 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f10a0021070 con 0x7f10ac0b4350 2024-09-21T06:59:58.798 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.796+0000 7f10b1a64640 1 -- 172.21.15.71:0/3267047799 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd new", "uuid": "50da4810-f26a-476b-b74c-d4c9a84ddb20", "id": 2} v 0) -- 0x7f10ac156980 con 0x7f10ac0b4350 2024-09-21T06:59:58.801 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.800+0000 7f1093fff640 1 -- 172.21.15.71:0/3267047799 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "50da4810-f26a-476b-b74c-d4c9a84ddb20", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f10ac15fd40 con 0x7f10ac0b4350 2024-09-21T06:59:58.802 INFO:teuthology.orchestra.run.smithi071.stdout:2 2024-09-21T06:59:58.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.801+0000 7f10b1a64640 1 -- 172.21.15.71:0/3267047799 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10ac0b4350 msgr2=0x7f10ac14eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.801+0000 7f10b1a64640 1 --2- 172.21.15.71:0/3267047799 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10ac0b4350 0x7f10ac14eb10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f10a000c3a0 tx=0x7f10a000c860 comp rx=0 tx=0).stop 2024-09-21T06:59:58.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.801+0000 7f10b1a64640 1 -- 172.21.15.71:0/3267047799 shutdown_connections 2024-09-21T06:59:58.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.801+0000 7f10b1a64640 1 --2- 172.21.15.71:0/3267047799 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10ac15f930 0x7f10ac0713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.801+0000 7f10b1a64640 1 --2- 172.21.15.71:0/3267047799 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f10ac159300 0x7f10ac070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.801+0000 7f10b1a64640 1 --2- 172.21.15.71:0/3267047799 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f10ac0b4350 0x7f10ac14eb10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.801+0000 7f10b1a64640 1 -- 172.21.15.71:0/3267047799 >> 172.21.15.71:0/3267047799 conn(0x7f10ac09aa40 msgr2=0x7f10ac159990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:58.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.801+0000 7f10b1a64640 1 -- 172.21.15.71:0/3267047799 shutdown_connections 2024-09-21T06:59:58.803 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.801+0000 7f10b1a64640 1 -- 172.21.15.71:0/3267047799 wait complete. 2024-09-21T06:59:58.813 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new b5628000-3108-43fb-aa68-6b7d36a6a03f 3 2024-09-21T06:59:58.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.924+0000 7f2f53552640 1 -- 172.21.15.71:0/2571399503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f4c0b4760 msgr2=0x7f2f4c0b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.924+0000 7f2f53552640 1 --2- 172.21.15.71:0/2571399503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f4c0b4760 0x7f2f4c0b1340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2f44005fd0 tx=0x7f2f4402ab70 comp rx=0 tx=0).stop 2024-09-21T06:59:58.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.924+0000 7f2f53552640 1 -- 172.21.15.71:0/2571399503 shutdown_connections 2024-09-21T06:59:58.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.924+0000 7f2f53552640 1 --2- 172.21.15.71:0/2571399503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f4c0b4760 0x7f2f4c0b1340 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.924+0000 7f2f53552640 1 --2- 172.21.15.71:0/2571399503 >> v2:172.21.15.63:3300/0 conn(0x7f2f4c0b4350 0x7f2f4c0b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.926 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.924+0000 7f2f53552640 1 -- 172.21.15.71:0/2571399503 >> 172.21.15.71:0/2571399503 conn(0x7f2f4c0b3050 msgr2=0x7f2f4c0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:58.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.924+0000 7f2f53552640 1 -- 172.21.15.71:0/2571399503 shutdown_connections 2024-09-21T06:59:58.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.924+0000 7f2f53552640 1 -- 172.21.15.71:0/2571399503 wait complete. 2024-09-21T06:59:58.927 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.926+0000 7f2f53552640 1 Processor -- start 2024-09-21T06:59:58.928 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.926+0000 7f2f53552640 1 -- start start 2024-09-21T06:59:58.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.927+0000 7f2f53552640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f4c0b4350 0x7f2f4c06cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:58.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.927+0000 7f2f53552640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f4c0b4760 0x7f2f4c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:58.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f53552640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f4c0cf930 0x7f2f4c1469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:58.930 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f53552640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c15f900 con 0x7f2f4c0cf930 2024-09-21T06:59:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f53552640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4c15f780 con 0x7f2f4c0b4350 2024-09-21T06:59:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f53552640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2f4c15fa80 con 0x7f2f4c0b4760 2024-09-21T06:59:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f50aed640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f4c0b4760 0x7f2f4c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f512ee640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f4c0b4350 0x7f2f4c06cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f50aed640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f4c0b4760 0x7f2f4c06d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:35084/0 (socket says 172.21.15.71:35084) 2024-09-21T06:59:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f50aed640 1 -- 172.21.15.71:0/1384707695 learned_addr learned my addr 172.21.15.71:0/1384707695 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-21T06:59:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f51aef640 1 --2- 172.21.15.71:0/1384707695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f4c0cf930 0x7f2f4c1469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f512ee640 1 -- 172.21.15.71:0/1384707695 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f4c0b4760 msgr2=0x7f2f4c06d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f512ee640 1 --2- 172.21.15.71:0/1384707695 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f4c0b4760 0x7f2f4c06d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f512ee640 1 -- 172.21.15.71:0/1384707695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f4c0cf930 msgr2=0x7f2f4c1469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f512ee640 1 --2- 172.21.15.71:0/1384707695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f4c0cf930 0x7f2f4c1469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f512ee640 1 -- 172.21.15.71:0/1384707695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4c1f7420 con 0x7f2f4c0b4350 2024-09-21T06:59:58.931 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f50aed640 1 --2- 172.21.15.71:0/1384707695 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f4c0b4760 0x7f2f4c06d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:59:58.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f512ee640 1 --2- 172.21.15.71:0/1384707695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f4c0b4350 0x7f2f4c06cdb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800c3c0 tx=0x7f2f4800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:58.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f3dffb640 1 -- 172.21.15.71:0/1384707695 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48017070 con 0x7f2f4c0b4350 2024-09-21T06:59:58.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f3dffb640 1 -- 172.21.15.71:0/1384707695 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f480053e0 con 0x7f2f4c0b4350 2024-09-21T06:59:58.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f53552640 1 -- 172.21.15.71:0/1384707695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4c1f7700 con 0x7f2f4c0b4350 2024-09-21T06:59:58.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.928+0000 7f2f3dffb640 1 -- 172.21.15.71:0/1384707695 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48003850 con 0x7f2f4c0b4350 2024-09-21T06:59:58.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.929+0000 7f2f53552640 1 -- 172.21.15.71:0/1384707695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f4c14ac20 con 0x7f2f4c0b4350 2024-09-21T06:59:58.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.929+0000 7f2f3dffb640 1 -- 172.21.15.71:0/1384707695 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2f4801a070 con 0x7f2f4c0b4350 2024-09-21T06:59:58.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.929+0000 7f2f3dffb640 1 -- 172.21.15.71:0/1384707695 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f2f48011d00 con 0x7f2f4c0b4350 2024-09-21T06:59:58.932 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.930+0000 7f2f53552640 1 -- 172.21.15.71:0/1384707695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f4c0b69e0 con 0x7f2f4c0b4350 2024-09-21T06:59:58.935 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:58.933+0000 7f2f3dffb640 1 -- 172.21.15.71:0/1384707695 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2f48021070 con 0x7f2f4c0b4350 2024-09-21T06:59:59.006 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.004+0000 7f2f53552640 1 -- 172.21.15.71:0/1384707695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b5628000-3108-43fb-aa68-6b7d36a6a03f", "id": 3} v 0) -- 0x7f2f4c0aef20 con 0x7f2f4c0b4350 2024-09-21T06:59:59.010 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.008+0000 7f2f3dffb640 1 -- 172.21.15.71:0/1384707695 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b5628000-3108-43fb-aa68-6b7d36a6a03f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f2f48011590 con 0x7f2f4c0b4350 2024-09-21T06:59:59.010 INFO:teuthology.orchestra.run.smithi071.stdout:3 2024-09-21T06:59:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.009+0000 7f2f53552640 1 -- 172.21.15.71:0/1384707695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f4c0b4350 msgr2=0x7f2f4c06cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.009+0000 7f2f53552640 1 --2- 172.21.15.71:0/1384707695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f4c0b4350 0x7f2f4c06cdb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f4800c3c0 tx=0x7f2f4800c880 comp rx=0 tx=0).stop 2024-09-21T06:59:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.010+0000 7f2f53552640 1 -- 172.21.15.71:0/1384707695 shutdown_connections 2024-09-21T06:59:59.011 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.010+0000 7f2f53552640 1 --2- 172.21.15.71:0/1384707695 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f4c0cf930 0x7f2f4c1469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.010+0000 7f2f53552640 1 --2- 172.21.15.71:0/1384707695 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f4c0b4760 0x7f2f4c06d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.010+0000 7f2f53552640 1 --2- 172.21.15.71:0/1384707695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f4c0b4350 0x7f2f4c06cdb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.010+0000 7f2f53552640 1 -- 172.21.15.71:0/1384707695 >> 172.21.15.71:0/1384707695 conn(0x7f2f4c0b3050 msgr2=0x7f2f4c0b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.010+0000 7f2f53552640 1 -- 172.21.15.71:0/1384707695 shutdown_connections 2024-09-21T06:59:59.012 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.010+0000 7f2f53552640 1 -- 172.21.15.71:0/1384707695 wait complete. 2024-09-21T06:59:59.021 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new 83b75617-6b8d-4f35-8aac-12c1dcc35b16 4 2024-09-21T06:59:59.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.132+0000 7ff7565ba640 1 -- 172.21.15.71:0/1672709778 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7500b1d90 msgr2=0x7ff7500b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.132+0000 7ff7565ba640 1 --2- 172.21.15.71:0/1672709778 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7500b1d90 0x7ff7500b21a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff7500b3cd0 tx=0x7ff73802a4d0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.132+0000 7ff7565ba640 1 -- 172.21.15.71:0/1672709778 shutdown_connections 2024-09-21T06:59:59.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.132+0000 7ff7565ba640 1 --2- 172.21.15.71:0/1672709778 >> v2:172.21.15.71:3300/0 conn(0x7ff7500d09a0 0x7ff7500d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.132+0000 7ff7565ba640 1 --2- 172.21.15.71:0/1672709778 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7500b1d90 0x7ff7500b21a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.132+0000 7ff7565ba640 1 --2- 172.21.15.71:0/1672709778 >> v2:172.21.15.63:3300/0 conn(0x7ff7500b1840 0x7ff7500b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.132+0000 7ff7565ba640 1 -- 172.21.15.71:0/1672709778 >> 172.21.15.71:0/1672709778 conn(0x7ff7500cef40 msgr2=0x7ff7500cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:59.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.132+0000 7ff7565ba640 1 -- 172.21.15.71:0/1672709778 shutdown_connections 2024-09-21T06:59:59.134 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.132+0000 7ff7565ba640 1 -- 172.21.15.71:0/1672709778 wait complete. 2024-09-21T06:59:59.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.133+0000 7ff7565ba640 1 Processor -- start 2024-09-21T06:59:59.135 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.134+0000 7ff7565ba640 1 -- start start 2024-09-21T06:59:59.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff7565ba640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7500b1840 0x7ff750155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:59.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff7565ba640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7500b1d90 0x7ff750158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:59.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff7565ba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7500d09a0 0x7ff7501f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:59.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff7565ba640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff7500b7e30 con 0x7ff7500b1840 2024-09-21T06:59:59.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff7565ba640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7500cecc0 con 0x7ff7500d09a0 2024-09-21T06:59:59.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff7565ba640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff7500b7fb0 con 0x7ff7500b1d90 2024-09-21T06:59:59.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff74f7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7500b1d90 0x7ff750158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:59.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff74f7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7500b1d90 0x7ff750158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:35114/0 (socket says 172.21.15.71:35114) 2024-09-21T06:59:59.138 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff74ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7500b1840 0x7ff750155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:59.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff754b57640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7500d09a0 0x7ff7501f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:59.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff74f7fe640 1 -- 172.21.15.71:0/2600260324 learned_addr learned my addr 172.21.15.71:0/2600260324 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-21T06:59:59.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff74f7fe640 1 -- 172.21.15.71:0/2600260324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7500d09a0 msgr2=0x7ff7501f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff74f7fe640 1 --2- 172.21.15.71:0/2600260324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7500d09a0 0x7ff7501f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff74f7fe640 1 -- 172.21.15.71:0/2600260324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7500b1840 msgr2=0x7ff750155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff74f7fe640 1 --2- 172.21.15.71:0/2600260324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7500b1840 0x7ff750155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff74f7fe640 1 -- 172.21.15.71:0/2600260324 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff750158ad0 con 0x7ff7500b1d90 2024-09-21T06:59:59.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.135+0000 7ff754b57640 1 --2- 172.21.15.71:0/2600260324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7500d09a0 0x7ff7501f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:59:59.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.136+0000 7ff74f7fe640 1 --2- 172.21.15.71:0/2600260324 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7500b1d90 0x7ff750158590 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff7380099c0 tx=0x7ff7380038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:59.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.136+0000 7ff74cff9640 1 -- 172.21.15.71:0/2600260324 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73803e030 con 0x7ff7500b1d90 2024-09-21T06:59:59.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.136+0000 7ff74cff9640 1 -- 172.21.15.71:0/2600260324 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff738003ca0 con 0x7ff7500b1d90 2024-09-21T06:59:59.139 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.136+0000 7ff7565ba640 1 -- 172.21.15.71:0/2600260324 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7501574f0 con 0x7ff7500b1d90 2024-09-21T06:59:59.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.136+0000 7ff74cff9640 1 -- 172.21.15.71:0/2600260324 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738035040 con 0x7ff7500b1d90 2024-09-21T06:59:59.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.136+0000 7ff7565ba640 1 -- 172.21.15.71:0/2600260324 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff750157ab0 con 0x7ff7500b1d90 2024-09-21T06:59:59.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.136+0000 7ff74cff9640 1 -- 172.21.15.71:0/2600260324 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff738041030 con 0x7ff7500b1d90 2024-09-21T06:59:59.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.136+0000 7ff74cff9640 1 -- 172.21.15.71:0/2600260324 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff738043ba0 con 0x7ff7500b1d90 2024-09-21T06:59:59.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.137+0000 7ff7565ba640 1 -- 172.21.15.71:0/2600260324 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7500b21a0 con 0x7ff7500b1d90 2024-09-21T06:59:59.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.139+0000 7ff74cff9640 1 -- 172.21.15.71:0/2600260324 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff738004f20 con 0x7ff7500b1d90 2024-09-21T06:59:59.210 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.208+0000 7ff7565ba640 1 -- 172.21.15.71:0/2600260324 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd new", "uuid": "83b75617-6b8d-4f35-8aac-12c1dcc35b16", "id": 4} v 0) -- 0x7ff7500c5d00 con 0x7ff7500b1d90 2024-09-21T06:59:59.213 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.212+0000 7ff74cff9640 1 -- 172.21.15.71:0/2600260324 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83b75617-6b8d-4f35-8aac-12c1dcc35b16", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7ff738043690 con 0x7ff7500b1d90 2024-09-21T06:59:59.213 INFO:teuthology.orchestra.run.smithi071.stdout:4 2024-09-21T06:59:59.214 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.213+0000 7ff7565ba640 1 -- 172.21.15.71:0/2600260324 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7500b1d90 msgr2=0x7ff750158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.213+0000 7ff7565ba640 1 --2- 172.21.15.71:0/2600260324 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7500b1d90 0x7ff750158590 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff7380099c0 tx=0x7ff7380038a0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.213+0000 7ff7565ba640 1 -- 172.21.15.71:0/2600260324 shutdown_connections 2024-09-21T06:59:59.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.213+0000 7ff7565ba640 1 --2- 172.21.15.71:0/2600260324 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7500d09a0 0x7ff7501f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.213+0000 7ff7565ba640 1 --2- 172.21.15.71:0/2600260324 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff7500b1d90 0x7ff750158590 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.213+0000 7ff7565ba640 1 --2- 172.21.15.71:0/2600260324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7500b1840 0x7ff750155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.213+0000 7ff7565ba640 1 -- 172.21.15.71:0/2600260324 >> 172.21.15.71:0/2600260324 conn(0x7ff7500cef40 msgr2=0x7ff75015cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:59.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.213+0000 7ff7565ba640 1 -- 172.21.15.71:0/2600260324 shutdown_connections 2024-09-21T06:59:59.215 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.213+0000 7ff7565ba640 1 -- 172.21.15.71:0/2600260324 wait complete. 2024-09-21T06:59:59.225 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new faef8d99-1065-4829-b459-3777c0945df1 5 2024-09-21T06:59:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.337+0000 7f4e66015640 1 -- 172.21.15.71:0/3144139997 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e600cd5d0 msgr2=0x7f4e601609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.337+0000 7f4e66015640 1 --2- 172.21.15.71:0/3144139997 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e600cd5d0 0x7f4e601609a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4e58005fd0 tx=0x7f4e5802aa90 comp rx=0 tx=0).stop 2024-09-21T06:59:59.339 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.337+0000 7f4e66015640 1 -- 172.21.15.71:0/3144139997 shutdown_connections 2024-09-21T06:59:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.337+0000 7f4e66015640 1 --2- 172.21.15.71:0/3144139997 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e600cd5d0 0x7f4e601609a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.337+0000 7f4e66015640 1 --2- 172.21.15.71:0/3144139997 >> v2:172.21.15.63:3300/0 conn(0x7f4e600b79d0 0x7f4e600d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.337+0000 7f4e66015640 1 -- 172.21.15.71:0/3144139997 >> 172.21.15.71:0/3144139997 conn(0x7f4e600ceed0 msgr2=0x7f4e600cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.337+0000 7f4e66015640 1 -- 172.21.15.71:0/3144139997 shutdown_connections 2024-09-21T06:59:59.340 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.337+0000 7f4e66015640 1 -- 172.21.15.71:0/3144139997 wait complete. 2024-09-21T06:59:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.339+0000 7f4e66015640 1 Processor -- start 2024-09-21T06:59:59.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.339+0000 7f4e66015640 1 -- start start 2024-09-21T06:59:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e66015640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e600b79d0 0x7f4e600cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e66015640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e600cd5d0 0x7f4e6006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e66015640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e600d0de0 0x7f4e600b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e66015640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4e600b19f0 con 0x7f4e600cd5d0 2024-09-21T06:59:59.344 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e66015640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4e600b1870 con 0x7f4e600b79d0 2024-09-21T06:59:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e66015640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4e600b7de0 con 0x7f4e600d0de0 2024-09-21T06:59:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e600b79d0 0x7f4e600cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5ffff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e600d0de0 0x7f4e600b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e600b79d0 0x7f4e600cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44352/0 (socket says 172.21.15.71:44352) 2024-09-21T06:59:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5f7fe640 1 -- 172.21.15.71:0/317435159 learned_addr learned my addr 172.21.15.71:0/317435159 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-21T06:59:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5ffff640 1 --2- 172.21.15.71:0/317435159 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e600d0de0 0x7f4e600b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:35130/0 (socket says 172.21.15.71:35130) 2024-09-21T06:59:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5effd640 1 --2- 172.21.15.71:0/317435159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e600cd5d0 0x7f4e6006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5f7fe640 1 -- 172.21.15.71:0/317435159 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e600d0de0 msgr2=0x7f4e600b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5f7fe640 1 --2- 172.21.15.71:0/317435159 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e600d0de0 0x7f4e600b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.345 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5f7fe640 1 -- 172.21.15.71:0/317435159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e600cd5d0 msgr2=0x7f4e6006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5f7fe640 1 --2- 172.21.15.71:0/317435159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e600cd5d0 0x7f4e6006f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5f7fe640 1 -- 172.21.15.71:0/317435159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6006e0a0 con 0x7f4e600b79d0 2024-09-21T06:59:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5ffff640 1 --2- 172.21.15.71:0/317435159 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e600d0de0 0x7f4e600b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:59:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5effd640 1 --2- 172.21.15.71:0/317435159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e600cd5d0 0x7f4e6006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:59:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e5f7fe640 1 --2- 172.21.15.71:0/317435159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e600b79d0 0x7f4e600cbc80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800e7f0 tx=0x7f4e4800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e57fff640 1 -- 172.21.15.71:0/317435159 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4800cc60 con 0x7f4e600b79d0 2024-09-21T06:59:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e57fff640 1 -- 172.21.15.71:0/317435159 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e48010430 con 0x7f4e600b79d0 2024-09-21T06:59:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.341+0000 7f4e66015640 1 -- 172.21.15.71:0/317435159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6006e380 con 0x7f4e600b79d0 2024-09-21T06:59:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.342+0000 7f4e57fff640 1 -- 172.21.15.71:0/317435159 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48010840 con 0x7f4e600b79d0 2024-09-21T06:59:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.342+0000 7f4e66015640 1 -- 172.21.15.71:0/317435159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e6006e940 con 0x7f4e600b79d0 2024-09-21T06:59:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.342+0000 7f4e57fff640 1 -- 172.21.15.71:0/317435159 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4e480109e0 con 0x7f4e600b79d0 2024-09-21T06:59:59.346 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.342+0000 7f4e57fff640 1 -- 172.21.15.71:0/317435159 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f4e48018c90 con 0x7f4e600b79d0 2024-09-21T06:59:59.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.342+0000 7f4e66015640 1 -- 172.21.15.71:0/317435159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e600b75b0 con 0x7f4e600b79d0 2024-09-21T06:59:59.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.345+0000 7f4e57fff640 1 -- 172.21.15.71:0/317435159 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4e600b75b0 con 0x7f4e600b79d0 2024-09-21T06:59:59.416 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.415+0000 7f4e66015640 1 -- 172.21.15.71:0/317435159 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "faef8d99-1065-4829-b459-3777c0945df1", "id": 5} v 0) -- 0x7f4e600d08a0 con 0x7f4e600b79d0 2024-09-21T06:59:59.420 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.419+0000 7f4e57fff640 1 -- 172.21.15.71:0/317435159 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "faef8d99-1065-4829-b459-3777c0945df1", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f4e48018420 con 0x7f4e600b79d0 2024-09-21T06:59:59.420 INFO:teuthology.orchestra.run.smithi071.stdout:5 2024-09-21T06:59:59.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.420+0000 7f4e66015640 1 -- 172.21.15.71:0/317435159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e600b79d0 msgr2=0x7f4e600cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.420+0000 7f4e66015640 1 --2- 172.21.15.71:0/317435159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e600b79d0 0x7f4e600cbc80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800e7f0 tx=0x7f4e4800ecb0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.420+0000 7f4e66015640 1 -- 172.21.15.71:0/317435159 shutdown_connections 2024-09-21T06:59:59.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.420+0000 7f4e66015640 1 --2- 172.21.15.71:0/317435159 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e600d0de0 0x7f4e600b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.420+0000 7f4e66015640 1 --2- 172.21.15.71:0/317435159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e600cd5d0 0x7f4e6006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.420+0000 7f4e66015640 1 --2- 172.21.15.71:0/317435159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e600b79d0 0x7f4e600cbc80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.420+0000 7f4e66015640 1 -- 172.21.15.71:0/317435159 >> 172.21.15.71:0/317435159 conn(0x7f4e600ceed0 msgr2=0x7f4e60071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:59.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.420+0000 7f4e66015640 1 -- 172.21.15.71:0/317435159 shutdown_connections 2024-09-21T06:59:59.422 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.420+0000 7f4e66015640 1 -- 172.21.15.71:0/317435159 wait complete. 2024-09-21T06:59:59.432 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new c533fc91-d14a-4378-9ff3-600db359e5a0 6 2024-09-21T06:59:59.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.542+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2458727416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1a80b94e0 msgr2=0x7fb1a80d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.544 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.542+0000 7fb1ae1f4640 1 --2- 172.21.15.71:0/2458727416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1a80b94e0 0x7fb1a80d1990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009860 tx=0x7fb1a402a4f0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.542+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2458727416 shutdown_connections 2024-09-21T06:59:59.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.542+0000 7fb1ae1f4640 1 --2- 172.21.15.71:0/2458727416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1a80b94e0 0x7fb1a80d1990 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.542+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2458727416 >> 172.21.15.71:0/2458727416 conn(0x7fb1a808bfd0 msgr2=0x7fb1a809d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:59.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.543+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2458727416 shutdown_connections 2024-09-21T06:59:59.545 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.543+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2458727416 wait complete. 2024-09-21T06:59:59.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.545+0000 7fb1ae1f4640 1 Processor -- start 2024-09-21T06:59:59.547 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.546+0000 7fb1ae1f4640 1 -- start start 2024-09-21T06:59:59.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ae1f4640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1a80b94e0 0x7fb1a815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:59.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ae1f4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1a80d2d60 0x7fb1a81f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:59.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ae1f4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1a81f5c90 0x7fb1a81e8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:59.551 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ae1f4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a80b88e0 con 0x7fb1a81f5c90 2024-09-21T06:59:59.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ae1f4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a80b8760 con 0x7fb1a80d2d60 2024-09-21T06:59:59.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ae1f4640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a80b8a60 con 0x7fb1a80b94e0 2024-09-21T06:59:59.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ad1f2640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1a80b94e0 0x7fb1a815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:59.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ac9f1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1a80d2d60 0x7fb1a81f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:59.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ad1f2640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1a80b94e0 0x7fb1a815afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:35138/0 (socket says 172.21.15.71:35138) 2024-09-21T06:59:59.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ac9f1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1a80d2d60 0x7fb1a81f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:44368/0 (socket says 172.21.15.71:44368) 2024-09-21T06:59:59.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ad1f2640 1 -- 172.21.15.71:0/2339953014 learned_addr learned my addr 172.21.15.71:0/2339953014 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-21T06:59:59.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ad9f3640 1 --2- 172.21.15.71:0/2339953014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1a81f5c90 0x7fb1a81e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:59.552 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ac9f1640 1 -- 172.21.15.71:0/2339953014 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1a80b94e0 msgr2=0x7fb1a815afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ac9f1640 1 --2- 172.21.15.71:0/2339953014 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1a80b94e0 0x7fb1a815afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ac9f1640 1 -- 172.21.15.71:0/2339953014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1a81f5c90 msgr2=0x7fb1a81e8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ac9f1640 1 --2- 172.21.15.71:0/2339953014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1a81f5c90 0x7fb1a81e8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ac9f1640 1 -- 172.21.15.71:0/2339953014 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a81e8070 con 0x7fb1a80d2d60 2024-09-21T06:59:59.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ad1f2640 1 --2- 172.21.15.71:0/2339953014 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1a80b94e0 0x7fb1a815afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:59:59.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb1ac9f1640 1 --2- 172.21.15.71:0/2339953014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1a80d2d60 0x7fb1a81f5750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c680 tx=0x7fb19c00cb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:59.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.548+0000 7fb199ffb640 1 -- 172.21.15.71:0/2339953014 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c017070 con 0x7fb1a80d2d60 2024-09-21T06:59:59.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.549+0000 7fb199ffb640 1 -- 172.21.15.71:0/2339953014 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb19c005360 con 0x7fb1a80d2d60 2024-09-21T06:59:59.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.549+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2339953014 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a81ea340 con 0x7fb1a80d2d60 2024-09-21T06:59:59.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.549+0000 7fb199ffb640 1 -- 172.21.15.71:0/2339953014 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c00a8a0 con 0x7fb1a80d2d60 2024-09-21T06:59:59.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.549+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2339953014 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a80cb470 con 0x7fb1a80d2d60 2024-09-21T06:59:59.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.549+0000 7fb199ffb640 1 -- 172.21.15.71:0/2339953014 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb19c01a070 con 0x7fb1a80d2d60 2024-09-21T06:59:59.553 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.549+0000 7fb199ffb640 1 -- 172.21.15.71:0/2339953014 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fb19c003d10 con 0x7fb1a80d2d60 2024-09-21T06:59:59.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.550+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2339953014 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a80d1990 con 0x7fb1a80d2d60 2024-09-21T06:59:59.554 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.552+0000 7fb199ffb640 1 -- 172.21.15.71:0/2339953014 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb19c021020 con 0x7fb1a80d2d60 2024-09-21T06:59:59.622 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.620+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2339953014 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c533fc91-d14a-4378-9ff3-600db359e5a0", "id": 6} v 0) -- 0x7fb1a8162160 con 0x7fb1a80d2d60 2024-09-21T06:59:59.625 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.624+0000 7fb199ffb640 1 -- 172.21.15.71:0/2339953014 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c533fc91-d14a-4378-9ff3-600db359e5a0", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fb1a80d3170 con 0x7fb1a80d2d60 2024-09-21T06:59:59.625 INFO:teuthology.orchestra.run.smithi071.stdout:6 2024-09-21T06:59:59.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.625+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2339953014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1a80d2d60 msgr2=0x7fb1a81f5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.626 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.625+0000 7fb1ae1f4640 1 --2- 172.21.15.71:0/2339953014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1a80d2d60 0x7fb1a81f5750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00c680 tx=0x7fb19c00cb40 comp rx=0 tx=0).stop 2024-09-21T06:59:59.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.625+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2339953014 shutdown_connections 2024-09-21T06:59:59.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.625+0000 7fb1ae1f4640 1 --2- 172.21.15.71:0/2339953014 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1a81f5c90 0x7fb1a81e8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.625+0000 7fb1ae1f4640 1 --2- 172.21.15.71:0/2339953014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1a80d2d60 0x7fb1a81f5750 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.625+0000 7fb1ae1f4640 1 --2- 172.21.15.71:0/2339953014 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1a80b94e0 0x7fb1a815afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.625+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2339953014 >> 172.21.15.71:0/2339953014 conn(0x7fb1a808bfd0 msgr2=0x7fb1a806f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:59.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.625+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2339953014 shutdown_connections 2024-09-21T06:59:59.627 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.625+0000 7fb1ae1f4640 1 -- 172.21.15.71:0/2339953014 wait complete. 2024-09-21T06:59:59.637 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd new a29980ab-aedd-464d-ac8f-bc73a58db089 7 2024-09-21T06:59:59.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.747+0000 7feb30d62640 1 -- 172.21.15.71:0/274587136 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb2c159300 msgr2=0x7feb2c15f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.747+0000 7feb30d62640 1 --2- 172.21.15.71:0/274587136 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb2c159300 0x7feb2c15f3f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feb14009860 tx=0x7feb1402a5a0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.749 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.747+0000 7feb30d62640 1 -- 172.21.15.71:0/274587136 shutdown_connections 2024-09-21T06:59:59.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.747+0000 7feb30d62640 1 --2- 172.21.15.71:0/274587136 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb2c159300 0x7feb2c15f3f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.747+0000 7feb30d62640 1 -- 172.21.15.71:0/274587136 >> 172.21.15.71:0/274587136 conn(0x7feb2c09aa40 msgr2=0x7feb2c0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:59.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.747+0000 7feb30d62640 1 -- 172.21.15.71:0/274587136 shutdown_connections 2024-09-21T06:59:59.750 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.747+0000 7feb30d62640 1 -- 172.21.15.71:0/274587136 wait complete. 2024-09-21T06:59:59.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.749+0000 7feb30d62640 1 Processor -- start 2024-09-21T06:59:59.751 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.749+0000 7feb30d62640 1 -- start start 2024-09-21T06:59:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb30d62640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c0b4350 0x7feb2c141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb30d62640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb2c159300 0x7feb2c0d1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb30d62640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb2c15f930 0x7feb2c0d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:59:59.753 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb30d62640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c0afd60 con 0x7feb2c15f930 2024-09-21T06:59:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb30d62640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c0afbe0 con 0x7feb2c0b4350 2024-09-21T06:59:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb30d62640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7feb2c0afee0 con 0x7feb2c159300 2024-09-21T06:59:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb29d9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb2c159300 0x7feb2c0d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb2a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c0b4350 0x7feb2c141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb29d9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb2c159300 0x7feb2c0d1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.71:35160/0 (socket says 172.21.15.71:35160) 2024-09-21T06:59:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb29d9b640 1 -- 172.21.15.71:0/3414208658 learned_addr learned my addr 172.21.15.71:0/3414208658 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-21T06:59:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb2ad9d640 1 --2- 172.21.15.71:0/3414208658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb2c15f930 0x7feb2c0d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:59:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb29d9b640 1 -- 172.21.15.71:0/3414208658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c0b4350 msgr2=0x7feb2c141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb29d9b640 1 --2- 172.21.15.71:0/3414208658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c0b4350 0x7feb2c141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb29d9b640 1 -- 172.21.15.71:0/3414208658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb2c15f930 msgr2=0x7feb2c0d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb29d9b640 1 --2- 172.21.15.71:0/3414208658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb2c15f930 0x7feb2c0d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.754 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb29d9b640 1 -- 172.21.15.71:0/3414208658 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c1f33f0 con 0x7feb2c159300 2024-09-21T06:59:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb29d9b640 1 --2- 172.21.15.71:0/3414208658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb2c159300 0x7feb2c0d1790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb1402ab90 tx=0x7feb14033ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:59:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb22ffd640 1 -- 172.21.15.71:0/3414208658 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14031b50 con 0x7feb2c159300 2024-09-21T06:59:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.751+0000 7feb22ffd640 1 -- 172.21.15.71:0/3414208658 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb14031de0 con 0x7feb2c159300 2024-09-21T06:59:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.752+0000 7feb30d62640 1 -- 172.21.15.71:0/3414208658 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2c1f3860 con 0x7feb2c159300 2024-09-21T06:59:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.752+0000 7feb22ffd640 1 -- 172.21.15.71:0/3414208658 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14005280 con 0x7feb2c159300 2024-09-21T06:59:59.755 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.752+0000 7feb30d62640 1 -- 172.21.15.71:0/3414208658 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feb2c1f62c0 con 0x7feb2c159300 2024-09-21T06:59:59.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.752+0000 7feb22ffd640 1 -- 172.21.15.71:0/3414208658 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feb140047a0 con 0x7feb2c159300 2024-09-21T06:59:59.756 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.752+0000 7feb22ffd640 1 -- 172.21.15.71:0/3414208658 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7feb140035f0 con 0x7feb2c159300 2024-09-21T06:59:59.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.753+0000 7feb30d62640 1 -- 172.21.15.71:0/3414208658 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2c15f3f0 con 0x7feb2c159300 2024-09-21T06:59:59.757 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.755+0000 7feb22ffd640 1 -- 172.21.15.71:0/3414208658 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7feb1403f030 con 0x7feb2c159300 2024-09-21T06:59:59.826 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.824+0000 7feb30d62640 1 -- 172.21.15.71:0/3414208658 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a29980ab-aedd-464d-ac8f-bc73a58db089", "id": 7} v 0) -- 0x7feb2c1f35c0 con 0x7feb2c159300 2024-09-21T06:59:59.829 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.828+0000 7feb22ffd640 1 -- 172.21.15.71:0/3414208658 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a29980ab-aedd-464d-ac8f-bc73a58db089", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7feb2c1f35c0 con 0x7feb2c159300 2024-09-21T06:59:59.829 INFO:teuthology.orchestra.run.smithi071.stdout:7 2024-09-21T06:59:59.830 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.829+0000 7feb30d62640 1 -- 172.21.15.71:0/3414208658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb2c159300 msgr2=0x7feb2c0d1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:59:59.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.829+0000 7feb30d62640 1 --2- 172.21.15.71:0/3414208658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb2c159300 0x7feb2c0d1790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb1402ab90 tx=0x7feb14033ba0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.829+0000 7feb30d62640 1 -- 172.21.15.71:0/3414208658 shutdown_connections 2024-09-21T06:59:59.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.829+0000 7feb30d62640 1 --2- 172.21.15.71:0/3414208658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb2c15f930 0x7feb2c0d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.829+0000 7feb30d62640 1 --2- 172.21.15.71:0/3414208658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7feb2c159300 0x7feb2c0d1790 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.829+0000 7feb30d62640 1 --2- 172.21.15.71:0/3414208658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feb2c0b4350 0x7feb2c141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:59:59.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.829+0000 7feb30d62640 1 -- 172.21.15.71:0/3414208658 >> 172.21.15.71:0/3414208658 conn(0x7feb2c09aa40 msgr2=0x7feb2c159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:59:59.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.829+0000 7feb30d62640 1 -- 172.21.15.71:0/3414208658 shutdown_connections 2024-09-21T06:59:59.831 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T06:59:59.829+0000 7feb30d62640 1 -- 172.21.15.71:0/3414208658 wait complete. 2024-09-21T06:59:59.841 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T06:59:59.841 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T06:59:59.843 INFO:tasks.ceph.osd.0:Started 2024-09-21T06:59:59.843 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T06:59:59.843 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T06:59:59.845 INFO:tasks.ceph.osd.1:Started 2024-09-21T06:59:59.845 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T06:59:59.846 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T06:59:59.848 INFO:tasks.ceph.osd.2:Started 2024-09-21T06:59:59.848 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T06:59:59.848 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T06:59:59.850 INFO:tasks.ceph.osd.3:Started 2024-09-21T06:59:59.850 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-21T06:59:59.850 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-21T06:59:59.852 INFO:tasks.ceph.osd.4:Started 2024-09-21T06:59:59.853 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-21T06:59:59.853 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-21T06:59:59.854 INFO:tasks.ceph.osd.5:Started 2024-09-21T06:59:59.855 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-21T06:59:59.855 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-21T06:59:59.856 INFO:tasks.ceph.osd.6:Started 2024-09-21T06:59:59.857 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T06:59:59.857 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T06:59:59.859 INFO:tasks.ceph.osd.7:Started 2024-09-21T06:59:59.859 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:00:00.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.002+0000 7f01a60d5640 1 -- 172.21.15.63:0/3515024422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01a00c61e0 msgr2=0x7f01a00d0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:00.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.002+0000 7f01a60d5640 1 --2- 172.21.15.63:0/3515024422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01a00c61e0 0x7f01a00d0290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0190009830 tx=0x7f019002a5c0 comp rx=0 tx=0).stop 2024-09-21T07:00:00.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.002+0000 7f01a60d5640 1 -- 172.21.15.63:0/3515024422 shutdown_connections 2024-09-21T07:00:00.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.002+0000 7f01a60d5640 1 --2- 172.21.15.63:0/3515024422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01a00c61e0 0x7f01a00d0290 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:00.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.002+0000 7f01a60d5640 1 -- 172.21.15.63:0/3515024422 >> 172.21.15.63:0/3515024422 conn(0x7f01a00b2f70 msgr2=0x7f01a00b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:00.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.002+0000 7f01a60d5640 1 -- 172.21.15.63:0/3515024422 shutdown_connections 2024-09-21T07:00:00.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.002+0000 7f01a60d5640 1 -- 172.21.15.63:0/3515024422 wait complete. 2024-09-21T07:00:00.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.004+0000 7f01a60d5640 1 Processor -- start 2024-09-21T07:00:00.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.004+0000 7f01a60d5640 1 -- start start 2024-09-21T07:00:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.005+0000 7f01a60d5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01a00c61e0 0x7f01a0146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.005+0000 7f01a60d5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01a00cf640 0x7f01a009d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.005+0000 7f01a60d5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01a00cfa50 0x7f01a009dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:00.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.005+0000 7f01a60d5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f01a0166d50 con 0x7f01a00c61e0 2024-09-21T07:00:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.005+0000 7f01a60d5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f01a0166bd0 con 0x7f01a00cfa50 2024-09-21T07:00:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.005+0000 7f01a60d5640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f01a0166ed0 con 0x7f01a00cf640 2024-09-21T07:00:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.005+0000 7f019f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01a00c61e0 0x7f01a0146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.005+0000 7f019f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01a00c61e0 0x7f01a0146db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43958/0 (socket says 172.21.15.63:43958) 2024-09-21T07:00:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.005+0000 7f019f7fe640 1 -- 172.21.15.63:0/1234031313 learned_addr learned my addr 172.21.15.63:0/1234031313 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.005+0000 7f019ffff640 1 --2- 172.21.15.63:0/1234031313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01a00cfa50 0x7f01a009dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f019f7fe640 1 -- 172.21.15.63:0/1234031313 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01a00cf640 msgr2=0x7f01a009d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.005+0000 7f019effd640 1 --2- 172.21.15.63:0/1234031313 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01a00cf640 0x7f01a009d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f019f7fe640 1 --2- 172.21.15.63:0/1234031313 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01a00cf640 0x7f01a009d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f019f7fe640 1 -- 172.21.15.63:0/1234031313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01a00cfa50 msgr2=0x7f01a009dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f019f7fe640 1 --2- 172.21.15.63:0/1234031313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01a00cfa50 0x7f01a009dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f019f7fe640 1 -- 172.21.15.63:0/1234031313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a01472f0 con 0x7f01a00c61e0 2024-09-21T07:00:00.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f019effd640 1 --2- 172.21.15.63:0/1234031313 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01a00cf640 0x7f01a009d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:00:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f019ffff640 1 --2- 172.21.15.63:0/1234031313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01a00cfa50 0x7f01a009dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f019f7fe640 1 --2- 172.21.15.63:0/1234031313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01a00c61e0 0x7f01a0146db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f019002abb0 tx=0x7f0190005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f0187fff640 1 -- 172.21.15.63:0/1234031313 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0190031600 con 0x7f01a00c61e0 2024-09-21T07:00:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f0187fff640 1 -- 172.21.15.63:0/1234031313 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0190031c90 con 0x7f01a00c61e0 2024-09-21T07:00:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f0187fff640 1 -- 172.21.15.63:0/1234031313 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01900332d0 con 0x7f01a00c61e0 2024-09-21T07:00:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f01a60d5640 1 -- 172.21.15.63:0/1234031313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a00af6e0 con 0x7f01a00c61e0 2024-09-21T07:00:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f01a60d5640 1 -- 172.21.15.63:0/1234031313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a00afca0 con 0x7f01a00c61e0 2024-09-21T07:00:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.006+0000 7f0187fff640 1 -- 172.21.15.63:0/1234031313 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0190033470 con 0x7f01a00c61e0 2024-09-21T07:00:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.007+0000 7f0187fff640 1 -- 172.21.15.63:0/1234031313 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0190033760 con 0x7f01a00c61e0 2024-09-21T07:00:00.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.008+0000 7f01a60d5640 1 -- 172.21.15.63:0/1234031313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a00d0290 con 0x7f01a00c61e0 2024-09-21T07:00:00.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.010+0000 7f0187fff640 1 -- 172.21.15.63:0/1234031313 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f019004a030 con 0x7f01a00c61e0 2024-09-21T07:00:00.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.071+0000 7f01a60d5640 1 -- 172.21.15.63:0/1234031313 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01a00d1c30 con 0x7f01a00c61e0 2024-09-21T07:00:00.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.072+0000 7f0187fff640 1 -- 172.21.15.63:0/1234031313 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f01a01472f0 con 0x7f01a00c61e0 2024-09-21T07:00:00.075 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:00.075 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T06:59:59.826223+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:00:00.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.073+0000 7f01a60d5640 1 -- 172.21.15.63:0/1234031313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01a00c61e0 msgr2=0x7f01a0146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:00.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.073+0000 7f01a60d5640 1 --2- 172.21.15.63:0/1234031313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01a00c61e0 0x7f01a0146db0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f019002abb0 tx=0x7f0190005d50 comp rx=0 tx=0).stop 2024-09-21T07:00:00.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.073+0000 7f01a60d5640 1 -- 172.21.15.63:0/1234031313 shutdown_connections 2024-09-21T07:00:00.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.073+0000 7f01a60d5640 1 --2- 172.21.15.63:0/1234031313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f01a00cfa50 0x7f01a009dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:00.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.073+0000 7f01a60d5640 1 --2- 172.21.15.63:0/1234031313 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f01a00cf640 0x7f01a009d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:00.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.073+0000 7f01a60d5640 1 --2- 172.21.15.63:0/1234031313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f01a00c61e0 0x7f01a0146db0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:00.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.073+0000 7f01a60d5640 1 -- 172.21.15.63:0/1234031313 >> 172.21.15.63:0/1234031313 conn(0x7f01a00b2f70 msgr2=0x7f01a015d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:00.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.073+0000 7f01a60d5640 1 -- 172.21.15.63:0/1234031313 shutdown_connections 2024-09-21T07:00:00.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:00.073+0000 7f01a60d5640 1 -- 172.21.15.63:0/1234031313 wait complete. 2024-09-21T07:00:00.086 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T07:00:00.086 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T07:00:00.892 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T07:00:01.000 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:00.997+0000 7fcbbdfad640 1 -- 172.21.15.63:0/3796505522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbb80ccc10 msgr2=0x7fcbb8073780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:01.001 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:00.997+0000 7fcbbdfad640 1 --2- 172.21.15.63:0/3796505522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbb80ccc10 0x7fcbb8073780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8073710 tx=0x7fcbac02a4d0 comp rx=0 tx=0).stop 2024-09-21T07:00:01.001 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:00.997+0000 7fcbbdfad640 1 -- 172.21.15.63:0/3796505522 shutdown_connections 2024-09-21T07:00:01.001 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:00.997+0000 7fcbbdfad640 1 --2- 172.21.15.63:0/3796505522 >> v2:172.21.15.71:3300/0 conn(0x7fcbb80cd020 0x7fcbb8073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:01.001 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:00.997+0000 7fcbbdfad640 1 --2- 172.21.15.63:0/3796505522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbb80ccc10 0x7fcbb8073780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:01.001 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:00.997+0000 7fcbbdfad640 1 --2- 172.21.15.63:0/3796505522 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcbb80b5f10 0x7fcbb815f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:01.001 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:00.997+0000 7fcbbdfad640 1 -- 172.21.15.63:0/3796505522 >> 172.21.15.63:0/3796505522 conn(0x7fcbb80cd6d0 msgr2=0x7fcbb80cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:01.001 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:00.998+0000 7fcbbdfad640 1 -- 172.21.15.63:0/3796505522 shutdown_connections 2024-09-21T07:00:01.001 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:00.998+0000 7fcbbdfad640 1 -- 172.21.15.63:0/3796505522 wait complete. 2024-09-21T07:00:01.002 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:00.999+0000 7fcbbdfad640 1 Processor -- start 2024-09-21T07:00:01.002 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:00.999+0000 7fcbbdfad640 1 -- start start 2024-09-21T07:00:01.005 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbbdfad640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb80b5f10 0x7fcbb81390e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:01.005 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbbdfad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbb80ccc10 0x7fcbb814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:01.005 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbbdfad640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcbb80cd020 0x7fcbb8139870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:01.005 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbbdfad640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb80ce640 con 0x7fcbb80ccc10 2024-09-21T07:00:01.005 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbbdfad640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb80b6700 con 0x7fcbb80b5f10 2024-09-21T07:00:01.005 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbbdfad640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcbb80ce7c0 con 0x7fcbb80cd020 2024-09-21T07:00:01.005 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbb6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbb80ccc10 0x7fcbb814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:01.005 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbb6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbb80ccc10 0x7fcbb814d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43976/0 (socket says 172.21.15.63:43976) 2024-09-21T07:00:01.005 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbb6ffd640 1 -- 172.21.15.63:0/1931053465 learned_addr learned my addr 172.21.15.63:0/1931053465 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:01.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbb7fff640 1 --2- 172.21.15.63:0/1931053465 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcbb80cd020 0x7fcbb8139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:01.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbb77fe640 1 --2- 172.21.15.63:0/1931053465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb80b5f10 0x7fcbb81390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:01.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbb6ffd640 1 -- 172.21.15.63:0/1931053465 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcbb80cd020 msgr2=0x7fcbb8139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:01.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbb6ffd640 1 --2- 172.21.15.63:0/1931053465 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcbb80cd020 0x7fcbb8139870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:01.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbb6ffd640 1 -- 172.21.15.63:0/1931053465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb80b5f10 msgr2=0x7fcbb81390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:01.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbb6ffd640 1 --2- 172.21.15.63:0/1931053465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb80b5f10 0x7fcbb81390e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:01.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbb6ffd640 1 -- 172.21.15.63:0/1931053465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb8138640 con 0x7fcbb80ccc10 2024-09-21T07:00:01.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbb7fff640 1 --2- 172.21.15.63:0/1931053465 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcbb80cd020 0x7fcbb8139870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:01.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbb77fe640 1 --2- 172.21.15.63:0/1931053465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb80b5f10 0x7fcbb81390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:01.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.001+0000 7fcbb6ffd640 1 --2- 172.21.15.63:0/1931053465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbb80ccc10 0x7fcbb814d2b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcbac034040 tx=0x7fcbac0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:01.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.002+0000 7fcb9ffff640 1 -- 172.21.15.63:0/1931053465 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac03e030 con 0x7fcbb80ccc10 2024-09-21T07:00:01.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.002+0000 7fcb9ffff640 1 -- 172.21.15.63:0/1931053465 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbac003ca0 con 0x7fcbb80ccc10 2024-09-21T07:00:01.006 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.002+0000 7fcbbdfad640 1 -- 172.21.15.63:0/1931053465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb813c5f0 con 0x7fcbb80ccc10 2024-09-21T07:00:01.007 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.002+0000 7fcb9ffff640 1 -- 172.21.15.63:0/1931053465 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac035040 con 0x7fcbb80ccc10 2024-09-21T07:00:01.007 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.002+0000 7fcbbdfad640 1 -- 172.21.15.63:0/1931053465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb813a260 con 0x7fcbb80ccc10 2024-09-21T07:00:01.007 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.003+0000 7fcbbdfad640 1 -- 172.21.15.63:0/1931053465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb815f230 con 0x7fcbb80ccc10 2024-09-21T07:00:01.007 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.003+0000 7fcb9ffff640 1 -- 172.21.15.63:0/1931053465 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7fcbac041030 con 0x7fcbb80ccc10 2024-09-21T07:00:01.007 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.003+0000 7fcb9ffff640 1 -- 172.21.15.63:0/1931053465 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fcbac072a30 con 0x7fcbb80ccc10 2024-09-21T07:00:01.008 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.005+0000 7fcb9ffff640 1 -- 172.21.15.63:0/1931053465 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fcbac004ca0 con 0x7fcbb80ccc10 2024-09-21T07:00:01.070 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.068+0000 7fcbbdfad640 1 -- 172.21.15.63:0/1931053465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcbb81563b0 con 0x7fcbb80ccc10 2024-09-21T07:00:01.071 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.068+0000 7fcb9ffff640 1 -- 172.21.15.63:0/1931053465 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fcbac0303a0 con 0x7fcbb80ccc10 2024-09-21T07:00:01.071 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-21T07:00:01.071 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":10,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T06:59:59.826223+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:00:01.072 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.069+0000 7fcbbdfad640 1 -- 172.21.15.63:0/1931053465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbb80ccc10 msgr2=0x7fcbb814d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:01.072 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.069+0000 7fcbbdfad640 1 --2- 172.21.15.63:0/1931053465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbb80ccc10 0x7fcbb814d2b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcbac034040 tx=0x7fcbac0038a0 comp rx=0 tx=0).stop 2024-09-21T07:00:01.072 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.069+0000 7fcbbdfad640 1 -- 172.21.15.63:0/1931053465 shutdown_connections 2024-09-21T07:00:01.072 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.069+0000 7fcbbdfad640 1 --2- 172.21.15.63:0/1931053465 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcbb80cd020 0x7fcbb8139870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:01.073 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.069+0000 7fcbbdfad640 1 --2- 172.21.15.63:0/1931053465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbb80ccc10 0x7fcbb814d2b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:01.073 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.069+0000 7fcbbdfad640 1 --2- 172.21.15.63:0/1931053465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcbb80b5f10 0x7fcbb81390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:01.073 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.069+0000 7fcbbdfad640 1 -- 172.21.15.63:0/1931053465 >> 172.21.15.63:0/1931053465 conn(0x7fcbb80cd6d0 msgr2=0x7fcbb8073680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:01.073 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.069+0000 7fcbbdfad640 1 -- 172.21.15.63:0/1931053465 shutdown_connections 2024-09-21T07:00:01.073 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:01.070+0000 7fcbbdfad640 1 -- 172.21.15.63:0/1931053465 wait complete. 2024-09-21T07:00:01.081 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T07:00:01.305 INFO:tasks.ceph.osd.4.smithi071.stderr:2024-09-21T07:00:01.303+0000 7f05e645e640 -1 Falling back to public interface 2024-09-21T07:00:01.327 INFO:tasks.ceph.osd.6.smithi071.stderr:2024-09-21T07:00:01.325+0000 7f9ba2617640 -1 Falling back to public interface 2024-09-21T07:00:01.565 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-21T07:00:01.563+0000 7f577e01e640 -1 Falling back to public interface 2024-09-21T07:00:01.601 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-21T07:00:01.599+0000 7fd141631640 -1 Falling back to public interface 2024-09-21T07:00:01.602 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-21T07:00:01.600+0000 7f51df20c640 -1 Falling back to public interface 2024-09-21T07:00:01.602 INFO:tasks.ceph.osd.7.smithi071.stderr:2024-09-21T07:00:01.600+0000 7fce65c2c640 -1 Falling back to public interface 2024-09-21T07:00:01.603 INFO:tasks.ceph.osd.7.smithi071.stderr:2024-09-21T07:00:01.602+0000 7fce6419e640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6820/0: (98) Address already in use 2024-09-21T07:00:01.604 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-09-21T07:00:01.603+0000 7fd6d6038640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T07:00:01.605 INFO:tasks.ceph.mgr.x.smithi071.stderr:2024-09-21T07:00:01.603+0000 7fd6d6038640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T07:00:01.605 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-21T07:00:01.603+0000 7f51ddbf2640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6824/0: (98) Address already in use 2024-09-21T07:00:01.834 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-21T07:00:01.833+0000 7fa84a40e640 -1 Falling back to public interface 2024-09-21T07:00:01.837 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-21T07:00:01.836+0000 7feb619d9640 -1 Falling back to public interface 2024-09-21T07:00:05.060 INFO:tasks.ceph.osd.4.smithi071.stderr:2024-09-21T07:00:05.059+0000 7f05e645e640 -1 osd.4 0 log_to_monitors true 2024-09-21T07:00:05.143 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-21T07:00:05.141+0000 7f51df20c640 -1 osd.5 0 log_to_monitors true 2024-09-21T07:00:05.372 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-21T07:00:05.370+0000 7feb619d9640 -1 osd.2 0 log_to_monitors true 2024-09-21T07:00:05.417 INFO:tasks.ceph.osd.6.smithi071.stderr:2024-09-21T07:00:05.416+0000 7f9ba2617640 -1 osd.6 0 log_to_monitors true 2024-09-21T07:00:05.431 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-21T07:00:05.429+0000 7f577e01e640 -1 osd.0 0 log_to_monitors true 2024-09-21T07:00:05.682 INFO:tasks.ceph.osd.7.smithi071.stderr:2024-09-21T07:00:05.681+0000 7fce65c2c640 -1 osd.7 0 log_to_monitors true 2024-09-21T07:00:05.695 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-21T07:00:05.694+0000 7fa84a40e640 -1 osd.3 0 log_to_monitors true 2024-09-21T07:00:05.701 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-21T07:00:05.700+0000 7fd141631640 -1 osd.1 0 log_to_monitors true 2024-09-21T07:00:07.008 INFO:tasks.ceph.osd.4.smithi071.stderr:2024-09-21T07:00:07.006+0000 7f05e2c01640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T07:00:07.018 INFO:tasks.ceph.osd.4.smithi071.stderr:2024-09-21T07:00:07.017+0000 7f05da1e2640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:00:07.888 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T07:00:08.011 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.009+0000 7f5960d51640 1 -- 172.21.15.63:0/1284538012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595c0d1580 msgr2=0x7f595c0b7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:08.011 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.009+0000 7f5960d51640 1 --2- 172.21.15.63:0/1284538012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595c0d1580 0x7f595c0b7e30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5954005fd0 tx=0x7f595402aa90 comp rx=0 tx=0).stop 2024-09-21T07:00:08.011 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.009+0000 7f5960d51640 1 -- 172.21.15.63:0/1284538012 shutdown_connections 2024-09-21T07:00:08.011 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.009+0000 7f5960d51640 1 --2- 172.21.15.63:0/1284538012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595c0d1580 0x7f595c0b7e30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:08.011 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.009+0000 7f5960d51640 1 --2- 172.21.15.63:0/1284538012 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f595c15e9b0 0x7f595c0d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:08.011 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.009+0000 7f5960d51640 1 -- 172.21.15.63:0/1284538012 >> 172.21.15.63:0/1284538012 conn(0x7f595c06dd90 msgr2=0x7f595c06e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:08.011 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.009+0000 7f5960d51640 1 -- 172.21.15.63:0/1284538012 shutdown_connections 2024-09-21T07:00:08.011 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.009+0000 7f5960d51640 1 -- 172.21.15.63:0/1284538012 wait complete. 2024-09-21T07:00:08.012 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.011+0000 7f5960d51640 1 Processor -- start 2024-09-21T07:00:08.013 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.011+0000 7f5960d51640 1 -- start start 2024-09-21T07:00:08.015 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.012+0000 7f5960d51640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595c0cf290 0x7f595c14c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:08.015 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.012+0000 7f5960d51640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f595c0d1580 0x7f595c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:08.015 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.012+0000 7f5960d51640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f595c15e9b0 0x7f595c1f9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:08.015 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.012+0000 7f5960d51640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f595c0b8950 con 0x7f595c15e9b0 2024-09-21T07:00:08.016 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.012+0000 7f5960d51640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f595c0b87d0 con 0x7f595c0cf290 2024-09-21T07:00:08.016 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.012+0000 7f5960d51640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f595c0b8ad0 con 0x7f595c0d1580 2024-09-21T07:00:08.016 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.012+0000 7f595ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f595c15e9b0 0x7f595c1f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:08.016 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.012+0000 7f595a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595c0cf290 0x7f595c14c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:08.016 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.012+0000 7f5959d9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f595c0d1580 0x7f595c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:08.016 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.012+0000 7f5959d9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f595c0d1580 0x7f595c0cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:41596/0 (socket says 172.21.15.63:41596) 2024-09-21T07:00:08.016 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.012+0000 7f595ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f595c15e9b0 0x7f595c1f9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44008/0 (socket says 172.21.15.63:44008) 2024-09-21T07:00:08.016 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.012+0000 7f5959d9b640 1 -- 172.21.15.63:0/1398013683 learned_addr learned my addr 172.21.15.63:0/1398013683 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:08.016 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.012+0000 7f595a59c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595c0cf290 0x7f595c14c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:53228/0 (socket says 172.21.15.63:53228) 2024-09-21T07:00:08.016 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.013+0000 7f5959d9b640 1 -- 172.21.15.63:0/1398013683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595c0cf290 msgr2=0x7f595c14c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:08.016 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.013+0000 7f5959d9b640 1 --2- 172.21.15.63:0/1398013683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595c0cf290 0x7f595c14c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:08.017 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.013+0000 7f5959d9b640 1 -- 172.21.15.63:0/1398013683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f595c15e9b0 msgr2=0x7f595c1f9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:08.017 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.013+0000 7f5959d9b640 1 --2- 172.21.15.63:0/1398013683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f595c15e9b0 0x7f595c1f9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:08.017 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.013+0000 7f5959d9b640 1 -- 172.21.15.63:0/1398013683 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c14d2e0 con 0x7f595c0d1580 2024-09-21T07:00:08.017 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.013+0000 7f5959d9b640 1 --2- 172.21.15.63:0/1398013683 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f595c0d1580 0x7f595c0cd7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f595000e6d0 tx=0x7f595000eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:08.017 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.013+0000 7f594affd640 1 -- 172.21.15.63:0/1398013683 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595000ca50 con 0x7f595c0d1580 2024-09-21T07:00:08.017 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.013+0000 7f594affd640 1 -- 172.21.15.63:0/1398013683 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f595000cce0 con 0x7f595c0d1580 2024-09-21T07:00:08.017 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.013+0000 7f5960d51640 1 -- 172.21.15.63:0/1398013683 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595c14d5c0 con 0x7f595c0d1580 2024-09-21T07:00:08.017 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.013+0000 7f594affd640 1 -- 172.21.15.63:0/1398013683 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950010690 con 0x7f595c0d1580 2024-09-21T07:00:08.017 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.013+0000 7f5960d51640 1 -- 172.21.15.63:0/1398013683 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f595c1f8e00 con 0x7f595c0d1580 2024-09-21T07:00:08.018 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.015+0000 7f5960d51640 1 -- 172.21.15.63:0/1398013683 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f595c0b9030 con 0x7f595c0d1580 2024-09-21T07:00:08.018 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.015+0000 7f594affd640 1 -- 172.21.15.63:0/1398013683 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f5950010830 con 0x7f595c0d1580 2024-09-21T07:00:08.018 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.016+0000 7f594affd640 1 --2- 172.21.15.63:0/1398013683 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f593c078b30 0x7f593c07b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:08.018 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.016+0000 7f594affd640 1 -- 172.21.15.63:0/1398013683 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f595009a8a0 con 0x7f595c0d1580 2024-09-21T07:00:08.018 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.016+0000 7f595a59c640 1 --2- 172.21.15.63:0/1398013683 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f593c078b30 0x7f593c07b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:08.018 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.017+0000 7f595a59c640 1 --2- 172.21.15.63:0/1398013683 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f593c078b30 0x7f593c07b040 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f594c001720 tx=0x7f594c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:08.023 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.021+0000 7f594affd640 1 -- 172.21.15.63:0/1398013683 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5950063350 con 0x7f595c0d1580 2024-09-21T07:00:08.252 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.251+0000 7f5960d51640 1 -- 172.21.15.63:0/1398013683 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f595c15dfb0 con 0x7f595c0d1580 2024-09-21T07:00:08.253 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.252+0000 7f594affd640 1 -- 172.21.15.63:0/1398013683 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7555 (secure 0 0 0) 0x7f5950067d80 con 0x7f595c0d1580 2024-09-21T07:00:08.253 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-21T07:00:08.254 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":13,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:00:07.120516+0000","last_up_change":"2024-09-21T07:00:07.120516+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:00:08.257 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.255+0000 7f5960d51640 1 -- 172.21.15.63:0/1398013683 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f593c078b30 msgr2=0x7f593c07b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:08.257 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.255+0000 7f5960d51640 1 --2- 172.21.15.63:0/1398013683 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f593c078b30 0x7f593c07b040 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f594c001720 tx=0x7f594c009040 comp rx=0 tx=0).stop 2024-09-21T07:00:08.257 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.255+0000 7f5960d51640 1 -- 172.21.15.63:0/1398013683 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f595c0d1580 msgr2=0x7f595c0cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:08.257 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.255+0000 7f5960d51640 1 --2- 172.21.15.63:0/1398013683 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f595c0d1580 0x7f595c0cd7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f595000e6d0 tx=0x7f595000eb90 comp rx=0 tx=0).stop 2024-09-21T07:00:08.257 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.255+0000 7f5960d51640 1 -- 172.21.15.63:0/1398013683 shutdown_connections 2024-09-21T07:00:08.257 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.255+0000 7f5960d51640 1 --2- 172.21.15.63:0/1398013683 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f593c078b30 0x7f593c07b040 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:08.257 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.255+0000 7f5960d51640 1 --2- 172.21.15.63:0/1398013683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f595c15e9b0 0x7f595c1f9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:08.257 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.255+0000 7f5960d51640 1 --2- 172.21.15.63:0/1398013683 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f595c0d1580 0x7f595c0cd7c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:08.258 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.255+0000 7f5960d51640 1 --2- 172.21.15.63:0/1398013683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f595c0cf290 0x7f595c14c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:08.258 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.255+0000 7f5960d51640 1 -- 172.21.15.63:0/1398013683 >> 172.21.15.63:0/1398013683 conn(0x7f595c06dd90 msgr2=0x7f595c160100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:08.258 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.255+0000 7f5960d51640 1 -- 172.21.15.63:0/1398013683 shutdown_connections 2024-09-21T07:00:08.258 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:08.255+0000 7f5960d51640 1 -- 172.21.15.63:0/1398013683 wait complete. 2024-09-21T07:00:08.267 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-21T07:00:08.842 INFO:tasks.ceph.osd.6.smithi071.stderr:2024-09-21T07:00:08.840+0000 7f9b9df05640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T07:00:08.857 INFO:tasks.ceph.osd.6.smithi071.stderr:2024-09-21T07:00:08.855+0000 7f9b95cfb640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:00:08.895 INFO:tasks.ceph.osd.7.smithi071.stderr:2024-09-21T07:00:08.893+0000 7fce61184640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T07:00:08.909 INFO:tasks.ceph.osd.7.smithi071.stderr:2024-09-21T07:00:08.907+0000 7fce58f7a640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:00:08.915 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-21T07:00:08.913+0000 7f51dabd8640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T07:00:08.930 INFO:tasks.ceph.osd.5.smithi071.stderr:2024-09-21T07:00:08.928+0000 7f51d29ce640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:00:09.272 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-21T07:00:09.271+0000 7fd13d5bf640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T07:00:09.283 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-21T07:00:09.282+0000 7f577a272640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T07:00:09.286 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-09-21T07:00:09.285+0000 7fd1353b5640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:00:09.303 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-09-21T07:00:09.302+0000 7f5771853640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:00:09.326 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-21T07:00:09.324+0000 7feb5d967640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T07:00:09.348 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-09-21T07:00:09.347+0000 7feb5575d640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:00:09.366 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-21T07:00:09.364+0000 7fa846512640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T07:00:09.375 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-09-21T07:00:09.374+0000 7fa83daf3640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T07:00:15.074 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T07:00:15.196 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.194+0000 7fcf1f12b640 1 -- 172.21.15.63:0/3963822028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf180b3a60 msgr2=0x7fcf180d45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:15.196 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.194+0000 7fcf1f12b640 1 --2- 172.21.15.63:0/3963822028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf180b3a60 0x7fcf180d45b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c005fd0 tx=0x7fcf0c02a5f0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.196 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.194+0000 7fcf1f12b640 1 -- 172.21.15.63:0/3963822028 shutdown_connections 2024-09-21T07:00:15.196 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.194+0000 7fcf1f12b640 1 --2- 172.21.15.63:0/3963822028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf180b3a60 0x7fcf180d45b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.196 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.194+0000 7fcf1f12b640 1 -- 172.21.15.63:0/3963822028 >> 172.21.15.63:0/3963822028 conn(0x7fcf1808dcc0 msgr2=0x7fcf1809d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:15.196 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.194+0000 7fcf1f12b640 1 -- 172.21.15.63:0/3963822028 shutdown_connections 2024-09-21T07:00:15.197 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.194+0000 7fcf1f12b640 1 -- 172.21.15.63:0/3963822028 wait complete. 2024-09-21T07:00:15.197 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.196+0000 7fcf1f12b640 1 Processor -- start 2024-09-21T07:00:15.197 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.196+0000 7fcf1f12b640 1 -- start start 2024-09-21T07:00:15.200 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.197+0000 7fcf1f12b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf1808c1a0 0x7fcf181f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:15.200 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.197+0000 7fcf1f12b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf180b3a60 0x7fcf1809e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:15.200 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.197+0000 7fcf1f12b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf180d4af0 0x7fcf1815fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:15.200 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.197+0000 7fcf1f12b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcf180cfa90 con 0x7fcf1808c1a0 2024-09-21T07:00:15.200 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.197+0000 7fcf1f12b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcf180cf910 con 0x7fcf180d4af0 2024-09-21T07:00:15.200 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.197+0000 7fcf1f12b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcf180cfc10 con 0x7fcf180b3a60 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.197+0000 7fcf1cec7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf1808c1a0 0x7fcf181f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.197+0000 7fcf1cec7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf1808c1a0 0x7fcf181f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57188/0 (socket says 172.21.15.63:57188) 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.197+0000 7fcf1cec7640 1 -- 172.21.15.63:0/2270057904 learned_addr learned my addr 172.21.15.63:0/2270057904 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.198+0000 7fcf1d6c8640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf180d4af0 0x7fcf1815fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.198+0000 7fcf17fff640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf180b3a60 0x7fcf1809e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.198+0000 7fcf1cec7640 1 -- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf180b3a60 msgr2=0x7fcf1809e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.198+0000 7fcf1cec7640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf180b3a60 0x7fcf1809e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.198+0000 7fcf1cec7640 1 -- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf180d4af0 msgr2=0x7fcf1815fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.198+0000 7fcf1cec7640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf180d4af0 0x7fcf1815fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.198+0000 7fcf1cec7640 1 -- 172.21.15.63:0/2270057904 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1815a940 con 0x7fcf1808c1a0 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.198+0000 7fcf1cec7640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf1808c1a0 0x7fcf181f60c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800c340 tx=0x7fcf0800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.198+0000 7fcf157fa640 1 -- 172.21.15.63:0/2270057904 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08017070 con 0x7fcf1808c1a0 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.198+0000 7fcf157fa640 1 -- 172.21.15.63:0/2270057904 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf080035f0 con 0x7fcf1808c1a0 2024-09-21T07:00:15.201 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.198+0000 7fcf157fa640 1 -- 172.21.15.63:0/2270057904 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08003a40 con 0x7fcf1808c1a0 2024-09-21T07:00:15.202 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.198+0000 7fcf1f12b640 1 -- 172.21.15.63:0/2270057904 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf1815ac20 con 0x7fcf1808c1a0 2024-09-21T07:00:15.202 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.198+0000 7fcf1f12b640 1 -- 172.21.15.63:0/2270057904 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf180a1940 con 0x7fcf1808c1a0 2024-09-21T07:00:15.202 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.199+0000 7fcf1f12b640 1 -- 172.21.15.63:0/2270057904 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf180a1ba0 con 0x7fcf1808c1a0 2024-09-21T07:00:15.202 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.200+0000 7fcf157fa640 1 -- 172.21.15.63:0/2270057904 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7fcf0801a070 con 0x7fcf1808c1a0 2024-09-21T07:00:15.202 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.201+0000 7fcf157fa640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcf04078b00 0x7fcf0407b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:15.203 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.201+0000 7fcf157fa640 1 -- 172.21.15.63:0/2270057904 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fcf08099d70 con 0x7fcf1808c1a0 2024-09-21T07:00:15.203 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.201+0000 7fcf17fff640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcf04078b00 0x7fcf0407b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:15.203 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.202+0000 7fcf17fff640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcf04078b00 0x7fcf0407b010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c033000 tx=0x7fcf0c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:15.207 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.205+0000 7fcf157fa640 1 -- 172.21.15.63:0/2270057904 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcf08021020 con 0x7fcf1808c1a0 2024-09-21T07:00:15.292 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.290+0000 7fcf157fa640 1 -- 172.21.15.63:0/2270057904 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf0805e400 con 0x7fcf1808c1a0 2024-09-21T07:00:15.399 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.397+0000 7fcf1f12b640 1 -- 172.21.15.63:0/2270057904 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf181620f0 con 0x7fcf1808c1a0 2024-09-21T07:00:15.400 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.398+0000 7fcf157fa640 1 -- 172.21.15.63:0/2270057904 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12848 (secure 0 0 0) 0x7fcf180d4f00 con 0x7fcf1808c1a0 2024-09-21T07:00:15.400 INFO:teuthology.misc.health.smithi063.stdout: 2024-09-21T07:00:15.400 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":18,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:00:13.237183+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:00:15.403 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.401+0000 7fcf1f12b640 1 -- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcf04078b00 msgr2=0x7fcf0407b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:15.403 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.401+0000 7fcf1f12b640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcf04078b00 0x7fcf0407b010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c033000 tx=0x7fcf0c004730 comp rx=0 tx=0).stop 2024-09-21T07:00:15.403 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.401+0000 7fcf1f12b640 1 -- 172.21.15.63:0/2270057904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf1808c1a0 msgr2=0x7fcf181f60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:15.403 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.401+0000 7fcf1f12b640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf1808c1a0 0x7fcf181f60c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800c340 tx=0x7fcf0800c800 comp rx=0 tx=0).stop 2024-09-21T07:00:15.403 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.401+0000 7fcf1f12b640 1 -- 172.21.15.63:0/2270057904 shutdown_connections 2024-09-21T07:00:15.403 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.401+0000 7fcf1f12b640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcf04078b00 0x7fcf0407b010 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.403 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.401+0000 7fcf1f12b640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf180d4af0 0x7fcf1815fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.404 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.401+0000 7fcf1f12b640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcf180b3a60 0x7fcf1809e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.404 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.401+0000 7fcf1f12b640 1 --2- 172.21.15.63:0/2270057904 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcf1808c1a0 0x7fcf181f60c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.404 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.401+0000 7fcf1f12b640 1 -- 172.21.15.63:0/2270057904 >> 172.21.15.63:0/2270057904 conn(0x7fcf1808dcc0 msgr2=0x7fcf18075f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:15.404 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.401+0000 7fcf1f12b640 1 -- 172.21.15.63:0/2270057904 shutdown_connections 2024-09-21T07:00:15.404 INFO:teuthology.misc.health.smithi063.stderr:2024-09-21T07:00:15.401+0000 7fcf1f12b640 1 -- 172.21.15.63:0/2270057904 wait complete. 2024-09-21T07:00:15.413 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-21T07:00:15.413 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T07:00:15.413 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:00:15.413 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:00:15.415 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:00:15.415 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:00:15.416 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:00:15.417 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:00:15.418 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:00:15.418 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:00:15.420 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:00:15.420 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:00:15.420 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:00:15.422 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:00:15.423 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-21T07:00:15.423 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:00:15.503 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2024-09-21T07:00:15.504 INFO:tasks.ceph.mds.c.smithi063.stdout:starting mds.c at 2024-09-21T07:00:15.516 INFO:tasks.ceph.mds.b.smithi071.stdout:starting mds.b at 2024-09-21T07:00:15.516 INFO:tasks.ceph.mds.d.smithi071.stdout:starting mds.d at 2024-09-21T07:00:15.516 INFO:tasks.ceph.mds.b.smithi071.stderr:2024-09-21T07:00:15.514+0000 7ff05de2a640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-21T07:00:15.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.543+0000 7f5736c07640 1 -- 172.21.15.63:0/1324440469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57300b52a0 msgr2=0x7f57300b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:15.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.543+0000 7f5736c07640 1 --2- 172.21.15.63:0/1324440469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57300b52a0 0x7f57300b56b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f571c009830 tx=0x7f571c02a530 comp rx=0 tx=0).stop 2024-09-21T07:00:15.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.544+0000 7f5736c07640 1 -- 172.21.15.63:0/1324440469 shutdown_connections 2024-09-21T07:00:15.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.544+0000 7f5736c07640 1 --2- 172.21.15.63:0/1324440469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57300b52a0 0x7f57300b56b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.544+0000 7f5736c07640 1 -- 172.21.15.63:0/1324440469 >> 172.21.15.63:0/1324440469 conn(0x7f57300ceed0 msgr2=0x7f57300cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:15.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.544+0000 7f5736c07640 1 -- 172.21.15.63:0/1324440469 shutdown_connections 2024-09-21T07:00:15.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.544+0000 7f5736c07640 1 -- 172.21.15.63:0/1324440469 wait complete. 2024-09-21T07:00:15.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.545+0000 7f5736c07640 1 Processor -- start 2024-09-21T07:00:15.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.545+0000 7f5736c07640 1 -- start start 2024-09-21T07:00:15.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f5736c07640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f57300b52a0 0x7f573015bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:15.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f5736c07640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57300cd0b0 0x7f57300c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:15.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f5736c07640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57300d0350 0x7f57300c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:15.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f5736c07640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5730074610 con 0x7f57300cd0b0 2024-09-21T07:00:15.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f5736c07640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f57300d1400 con 0x7f57300d0350 2024-09-21T07:00:15.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f5736c07640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f57300b5bf0 con 0x7f57300b52a0 2024-09-21T07:00:15.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f572ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57300cd0b0 0x7f57300c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:15.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f572ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57300cd0b0 0x7f57300c75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57232/0 (socket says 172.21.15.63:57232) 2024-09-21T07:00:15.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f572ffff640 1 -- 172.21.15.63:0/2185383873 learned_addr learned my addr 172.21.15.63:0/2185383873 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:15.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f57349a3640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f57300b52a0 0x7f573015bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:15.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f57351a4640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57300d0350 0x7f57300c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:15.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f572ffff640 1 -- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f57300b52a0 msgr2=0x7f573015bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f572ffff640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f57300b52a0 0x7f573015bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f572ffff640 1 -- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57300d0350 msgr2=0x7f57300c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f572ffff640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57300d0350 0x7f57300c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.547+0000 7f572ffff640 1 -- 172.21.15.63:0/2185383873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57301f74d0 con 0x7f57300cd0b0 2024-09-21T07:00:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.548+0000 7f572ffff640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57300cd0b0 0x7f57300c75f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f571c009950 tx=0x7f571c033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.548+0000 7f572d7fa640 1 -- 172.21.15.63:0/2185383873 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c031b50 con 0x7f57300cd0b0 2024-09-21T07:00:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.548+0000 7f572d7fa640 1 -- 172.21.15.63:0/2185383873 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f571c031de0 con 0x7f57300cd0b0 2024-09-21T07:00:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.548+0000 7f572d7fa640 1 -- 172.21.15.63:0/2185383873 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571c005280 con 0x7f57300cd0b0 2024-09-21T07:00:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.548+0000 7f5736c07640 1 -- 172.21.15.63:0/2185383873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573015d790 con 0x7f57300cd0b0 2024-09-21T07:00:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.548+0000 7f5736c07640 1 -- 172.21.15.63:0/2185383873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57300c8670 con 0x7f57300cd0b0 2024-09-21T07:00:15.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.549+0000 7f5736c07640 1 -- 172.21.15.63:0/2185383873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57300c7230 con 0x7f57300cd0b0 2024-09-21T07:00:15.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.550+0000 7f572d7fa640 1 -- 172.21.15.63:0/2185383873 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f571c005420 con 0x7f57300cd0b0 2024-09-21T07:00:15.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.550+0000 7f572d7fa640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5714078bc0 0x7f571407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:15.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.550+0000 7f572d7fa640 1 -- 172.21.15.63:0/2185383873 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f571c0bba70 con 0x7f57300cd0b0 2024-09-21T07:00:15.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.550+0000 7f57349a3640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5714078bc0 0x7f571407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:15.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.551+0000 7f57349a3640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5714078bc0 0x7f571407b0d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f573009bcc0 tx=0x7f5724009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.555+0000 7f572d7fa640 1 -- 172.21.15.63:0/2185383873 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f571c03f030 con 0x7f57300cd0b0 2024-09-21T07:00:15.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.779+0000 7f5736c07640 1 -- 172.21.15.63:0/2185383873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57300b75e0 con 0x7f57300cd0b0 2024-09-21T07:00:15.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.780+0000 7f572d7fa640 1 -- 172.21.15.63:0/2185383873 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f571c031770 con 0x7f57300cd0b0 2024-09-21T07:00:15.782 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:15.782 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":2,"btime":"2024-09-21T07:00:15:507678+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/4041704430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":4041704430},{"type":"v1","addr":"172.21.15.63:6834","nonce":4041704430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T07:00:15.782 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 2 2024-09-21T07:00:15.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.782+0000 7f5736c07640 1 -- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5714078bc0 msgr2=0x7f571407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:15.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.782+0000 7f5736c07640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5714078bc0 0x7f571407b0d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f573009bcc0 tx=0x7f5724009040 comp rx=0 tx=0).stop 2024-09-21T07:00:15.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.782+0000 7f5736c07640 1 -- 172.21.15.63:0/2185383873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57300cd0b0 msgr2=0x7f57300c75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:15.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.782+0000 7f5736c07640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57300cd0b0 0x7f57300c75f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f571c009950 tx=0x7f571c033ba0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.782+0000 7f5736c07640 1 -- 172.21.15.63:0/2185383873 shutdown_connections 2024-09-21T07:00:15.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.782+0000 7f5736c07640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5714078bc0 0x7f571407b0d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.782+0000 7f5736c07640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57300d0350 0x7f57300c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.782+0000 7f5736c07640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f57300cd0b0 0x7f57300c75f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.782+0000 7f5736c07640 1 --2- 172.21.15.63:0/2185383873 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f57300b52a0 0x7f573015bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:15.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.782+0000 7f5736c07640 1 -- 172.21.15.63:0/2185383873 >> 172.21.15.63:0/2185383873 conn(0x7f57300ceed0 msgr2=0x7f573015c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:15.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.782+0000 7f5736c07640 1 -- 172.21.15.63:0/2185383873 shutdown_connections 2024-09-21T07:00:15.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:15.783+0000 7f5736c07640 1 -- 172.21.15.63:0/2185383873 wait complete. 2024-09-21T07:00:17.796 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:00:17.810 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:00:17.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:00:17.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.926+0000 7f93ecf6e640 1 -- 172.21.15.63:0/1052391011 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93e80b4bc0 msgr2=0x7f93e80b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:17.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.926+0000 7f93ecf6e640 1 --2- 172.21.15.63:0/1052391011 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93e80b4bc0 0x7f93e80b4fd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f93e0005fd0 tx=0x7f93e002a780 comp rx=0 tx=0).stop 2024-09-21T07:00:17.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.926+0000 7f93ecf6e640 1 -- 172.21.15.63:0/1052391011 shutdown_connections 2024-09-21T07:00:17.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.926+0000 7f93ecf6e640 1 --2- 172.21.15.63:0/1052391011 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93e80b4bc0 0x7f93e80b4fd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:17.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.926+0000 7f93ecf6e640 1 --2- 172.21.15.63:0/1052391011 >> v2:172.21.15.71:3300/0 conn(0x7f93e815c5d0 0x7f93e80d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:17.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.926+0000 7f93ecf6e640 1 -- 172.21.15.63:0/1052391011 >> 172.21.15.63:0/1052391011 conn(0x7f93e806cdb0 msgr2=0x7f93e806d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:17.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.926+0000 7f93ecf6e640 1 -- 172.21.15.63:0/1052391011 shutdown_connections 2024-09-21T07:00:17.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.926+0000 7f93ecf6e640 1 -- 172.21.15.63:0/1052391011 wait complete. 2024-09-21T07:00:17.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.928+0000 7f93ecf6e640 1 Processor -- start 2024-09-21T07:00:17.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.928+0000 7f93ecf6e640 1 -- start start 2024-09-21T07:00:17.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.929+0000 7f93ecf6e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93e80b4bc0 0x7f93e80a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:17.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.929+0000 7f93ecf6e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e815c5d0 0x7f93e814a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:17.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.929+0000 7f93ecf6e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93e815ec60 0x7f93e8159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:17.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.929+0000 7f93ecf6e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f93e80cf5f0 con 0x7f93e815c5d0 2024-09-21T07:00:17.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.929+0000 7f93ecf6e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93e80cf470 con 0x7f93e80b4bc0 2024-09-21T07:00:17.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.929+0000 7f93ecf6e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f93e80cf770 con 0x7f93e815ec60 2024-09-21T07:00:17.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.929+0000 7f93e5d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e815c5d0 0x7f93e814a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.929+0000 7f93e5d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e815c5d0 0x7f93e814a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57246/0 (socket says 172.21.15.63:57246) 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.929+0000 7f93e5d9b640 1 -- 172.21.15.63:0/876559503 learned_addr learned my addr 172.21.15.63:0/876559503 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.930+0000 7f93e659c640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93e80b4bc0 0x7f93e80a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.930+0000 7f93e6d9d640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93e815ec60 0x7f93e8159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.930+0000 7f93e5d9b640 1 -- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93e815ec60 msgr2=0x7f93e8159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.930+0000 7f93e5d9b640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93e815ec60 0x7f93e8159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.930+0000 7f93e5d9b640 1 -- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93e80b4bc0 msgr2=0x7f93e80a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.930+0000 7f93e5d9b640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93e80b4bc0 0x7f93e80a94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.930+0000 7f93e5d9b640 1 -- 172.21.15.63:0/876559503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e80aa800 con 0x7f93e815c5d0 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.930+0000 7f93e5d9b640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e815c5d0 0x7f93e814a660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00ea20 tx=0x7f93dc00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.930+0000 7f93d6ffd640 1 -- 172.21.15.63:0/876559503 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc00ce40 con 0x7f93e815c5d0 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.930+0000 7f93d6ffd640 1 -- 172.21.15.63:0/876559503 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93dc004020 con 0x7f93e815c5d0 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.930+0000 7f93ecf6e640 1 -- 172.21.15.63:0/876559503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e80a9f60 con 0x7f93e815c5d0 2024-09-21T07:00:17.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.930+0000 7f93d6ffd640 1 -- 172.21.15.63:0/876559503 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc004470 con 0x7f93e815c5d0 2024-09-21T07:00:17.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.930+0000 7f93ecf6e640 1 -- 172.21.15.63:0/876559503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e80aa520 con 0x7f93e815c5d0 2024-09-21T07:00:17.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.931+0000 7f93ecf6e640 1 -- 172.21.15.63:0/876559503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e80cfc20 con 0x7f93e815c5d0 2024-09-21T07:00:17.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.932+0000 7f93d6ffd640 1 -- 172.21.15.63:0/876559503 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f93dc0035f0 con 0x7f93e815c5d0 2024-09-21T07:00:17.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.933+0000 7f93d6ffd640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f93c8078b90 0x7f93c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:17.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.933+0000 7f93d6ffd640 1 -- 172.21.15.63:0/876559503 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f93dc09b3e0 con 0x7f93e815c5d0 2024-09-21T07:00:17.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.933+0000 7f93e659c640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f93c8078b90 0x7f93c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:17.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.933+0000 7f93e659c640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f93c8078b90 0x7f93c807b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f93e80cddd0 tx=0x7f93d8007e90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:17.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:17.937+0000 7f93d6ffd640 1 -- 172.21.15.63:0/876559503 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f93dc063520 con 0x7f93e815c5d0 2024-09-21T07:00:18.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.164+0000 7f93ecf6e640 1 -- 172.21.15.63:0/876559503 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93e80b5070 con 0x7f93e815c5d0 2024-09-21T07:00:18.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.164+0000 7f93d6ffd640 1 -- 172.21.15.63:0/876559503 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3897 (secure 0 0 0) 0x7f93dc067f50 con 0x7f93e815c5d0 2024-09-21T07:00:18.166 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:18.166 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":3,"btime":"2024-09-21T07:00:16:508670+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/4041704430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":4041704430},{"type":"v1","addr":"172.21.15.63:6834","nonce":4041704430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1032053510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":1032053510},{"type":"v1","addr":"172.21.15.63:6835","nonce":1032053510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/18747791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":18747791},{"type":"v1","addr":"172.21.15.71:6836","nonce":18747791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4410,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/767391345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":767391345},{"type":"v1","addr":"172.21.15.71:6837","nonce":767391345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T07:00:18.166 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 3 2024-09-21T07:00:18.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.167+0000 7f93ecf6e640 1 -- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f93c8078b90 msgr2=0x7f93c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:18.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.167+0000 7f93ecf6e640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f93c8078b90 0x7f93c807b0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f93e80cddd0 tx=0x7f93d8007e90 comp rx=0 tx=0).stop 2024-09-21T07:00:18.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.167+0000 7f93ecf6e640 1 -- 172.21.15.63:0/876559503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e815c5d0 msgr2=0x7f93e814a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:18.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.167+0000 7f93ecf6e640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e815c5d0 0x7f93e814a660 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00ea20 tx=0x7f93dc00eee0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.167+0000 7f93ecf6e640 1 -- 172.21.15.63:0/876559503 shutdown_connections 2024-09-21T07:00:18.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.167+0000 7f93ecf6e640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f93c8078b90 0x7f93c807b0a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.167+0000 7f93ecf6e640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93e815ec60 0x7f93e8159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.167+0000 7f93ecf6e640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93e815c5d0 0x7f93e814a660 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.167+0000 7f93ecf6e640 1 --2- 172.21.15.63:0/876559503 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93e80b4bc0 0x7f93e80a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.167+0000 7f93ecf6e640 1 -- 172.21.15.63:0/876559503 >> 172.21.15.63:0/876559503 conn(0x7f93e806cdb0 msgr2=0x7f93e815cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:18.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.167+0000 7f93ecf6e640 1 -- 172.21.15.63:0/876559503 shutdown_connections 2024-09-21T07:00:18.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.167+0000 7f93ecf6e640 1 -- 172.21.15.63:0/876559503 wait complete. 2024-09-21T07:00:18.179 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:00:18.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.333+0000 7ff603a27640 1 -- 172.21.15.63:0/3320639078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5fc08c960 msgr2=0x7ff5fc0d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.333+0000 7ff603a27640 1 --2- 172.21.15.63:0/3320639078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5fc08c960 0x7ff5fc0d1130 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc06db40 tx=0x7ff5f402a980 comp rx=0 tx=0).stop 2024-09-21T07:00:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.333+0000 7ff603a27640 1 -- 172.21.15.63:0/3320639078 shutdown_connections 2024-09-21T07:00:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.333+0000 7ff603a27640 1 --2- 172.21.15.63:0/3320639078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5fc08c960 0x7ff5fc0d1130 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.333+0000 7ff603a27640 1 --2- 172.21.15.63:0/3320639078 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff5fc0b9aa0 0x7ff5fc0d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.333+0000 7ff603a27640 1 --2- 172.21.15.63:0/3320639078 >> v2:172.21.15.71:3300/0 conn(0x7ff5fc0b3aa0 0x7ff5fc0d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.333+0000 7ff603a27640 1 -- 172.21.15.63:0/3320639078 >> 172.21.15.63:0/3320639078 conn(0x7ff5fc0d45e0 msgr2=0x7ff5fc0d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.334+0000 7ff603a27640 1 -- 172.21.15.63:0/3320639078 shutdown_connections 2024-09-21T07:00:18.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.334+0000 7ff603a27640 1 -- 172.21.15.63:0/3320639078 wait complete. 2024-09-21T07:00:18.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.335+0000 7ff603a27640 1 Processor -- start 2024-09-21T07:00:18.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.335+0000 7ff603a27640 1 -- start start 2024-09-21T07:00:18.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff603a27640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff5fc08c960 0x7ff5fc1f9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:18.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff603a27640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5fc0b3aa0 0x7ff5fc1f9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:18.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff603a27640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5fc0b9aa0 0x7ff5fc1f9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:18.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff603a27640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc06ed80 con 0x7ff5fc0b9aa0 2024-09-21T07:00:18.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff603a27640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc06ec00 con 0x7ff5fc0b3aa0 2024-09-21T07:00:18.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff603a27640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff5fc06ef00 con 0x7ff5fc08c960 2024-09-21T07:00:18.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff601fc4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5fc0b9aa0 0x7ff5fc1f9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:18.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff601fc4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5fc0b9aa0 0x7ff5fc1f9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57266/0 (socket says 172.21.15.63:57266) 2024-09-21T07:00:18.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff601fc4640 1 -- 172.21.15.63:0/244704748 learned_addr learned my addr 172.21.15.63:0/244704748 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:18.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff6017c3640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff5fc08c960 0x7ff5fc1f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:18.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff600fc2640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5fc0b3aa0 0x7ff5fc1f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:18.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff601fc4640 1 -- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff5fc08c960 msgr2=0x7ff5fc1f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff601fc4640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff5fc08c960 0x7ff5fc1f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff601fc4640 1 -- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5fc0b3aa0 msgr2=0x7ff5fc1f9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff601fc4640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5fc0b3aa0 0x7ff5fc1f9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff601fc4640 1 -- 172.21.15.63:0/244704748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc0b6760 con 0x7ff5fc0b9aa0 2024-09-21T07:00:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff600fc2640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5fc0b3aa0 0x7ff5fc1f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:00:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.337+0000 7ff601fc4640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5fc0b9aa0 0x7ff5fc1f9a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4033040 tx=0x7ff5f4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.338+0000 7ff5edffb640 1 -- 172.21.15.63:0/244704748 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4034040 con 0x7ff5fc0b9aa0 2024-09-21T07:00:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.338+0000 7ff5edffb640 1 -- 172.21.15.63:0/244704748 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5f4004540 con 0x7ff5fc0b9aa0 2024-09-21T07:00:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.338+0000 7ff603a27640 1 -- 172.21.15.63:0/244704748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5fc0b6a40 con 0x7ff5fc0b9aa0 2024-09-21T07:00:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.338+0000 7ff5edffb640 1 -- 172.21.15.63:0/244704748 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4045480 con 0x7ff5fc0b9aa0 2024-09-21T07:00:18.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.338+0000 7ff603a27640 1 -- 172.21.15.63:0/244704748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5fc0cdb70 con 0x7ff5fc0b9aa0 2024-09-21T07:00:18.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.339+0000 7ff603a27640 1 -- 172.21.15.63:0/244704748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5fc0d2fd0 con 0x7ff5fc0b9aa0 2024-09-21T07:00:18.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.340+0000 7ff5edffb640 1 -- 172.21.15.63:0/244704748 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff5f4037020 con 0x7ff5fc0b9aa0 2024-09-21T07:00:18.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.340+0000 7ff5edffb640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff5e0078b90 0x7ff5e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:18.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.340+0000 7ff5edffb640 1 -- 172.21.15.63:0/244704748 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff5f40bc2b0 con 0x7ff5fc0b9aa0 2024-09-21T07:00:18.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.340+0000 7ff6017c3640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff5e0078b90 0x7ff5e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:18.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.341+0000 7ff6017c3640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff5e0078b90 0x7ff5e007b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8005fd0 tx=0x7ff5f8005da0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:18.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.345+0000 7ff5edffb640 1 -- 172.21.15.63:0/244704748 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff5f4084ae0 con 0x7ff5fc0b9aa0 2024-09-21T07:00:18.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.533+0000 7ff603a27640 1 -- 172.21.15.63:0/244704748 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff5fc0b74b0 con 0x7ff5fc0b9aa0 2024-09-21T07:00:18.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.533+0000 7ff5edffb640 1 -- 172.21.15.63:0/244704748 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7ff5f408d020 con 0x7ff5fc0b9aa0 2024-09-21T07:00:18.535 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:18.535 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2024-09-21T07:00:18.535 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:18.535 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2024-09-21T07:00:18.535 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2024-09-21T07:00:18.535 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:18.536 INFO:teuthology.orchestra.run.smithi063.stdout:] 2024-09-21T07:00:18.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.535+0000 7ff603a27640 1 -- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff5e0078b90 msgr2=0x7ff5e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.535+0000 7ff603a27640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff5e0078b90 0x7ff5e007b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8005fd0 tx=0x7ff5f8005da0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.535+0000 7ff603a27640 1 -- 172.21.15.63:0/244704748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5fc0b9aa0 msgr2=0x7ff5fc1f9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.535+0000 7ff603a27640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5fc0b9aa0 0x7ff5fc1f9a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4033040 tx=0x7ff5f4003f10 comp rx=0 tx=0).stop 2024-09-21T07:00:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.535+0000 7ff603a27640 1 -- 172.21.15.63:0/244704748 shutdown_connections 2024-09-21T07:00:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.535+0000 7ff603a27640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff5e0078b90 0x7ff5e007b0a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.535+0000 7ff603a27640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5fc0b9aa0 0x7ff5fc1f9a90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.535+0000 7ff603a27640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5fc0b3aa0 0x7ff5fc1f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.535+0000 7ff603a27640 1 --2- 172.21.15.63:0/244704748 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff5fc08c960 0x7ff5fc1f9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.535+0000 7ff603a27640 1 -- 172.21.15.63:0/244704748 >> 172.21.15.63:0/244704748 conn(0x7ff5fc0d45e0 msgr2=0x7ff5fc0b8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:18.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.535+0000 7ff603a27640 1 -- 172.21.15.63:0/244704748 shutdown_connections 2024-09-21T07:00:18.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.535+0000 7ff603a27640 1 -- 172.21.15.63:0/244704748 wait complete. 2024-09-21T07:00:18.548 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:00:18.548 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:00:18.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.666+0000 7f3e18758640 1 -- 172.21.15.63:0/3425083738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100b35b0 msgr2=0x7f3e100b9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:18.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.666+0000 7f3e18758640 1 --2- 172.21.15.63:0/3425083738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100b35b0 0x7f3e100b9c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e080098e0 tx=0x7f3e0802a530 comp rx=0 tx=0).stop 2024-09-21T07:00:18.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.666+0000 7f3e18758640 1 -- 172.21.15.63:0/3425083738 shutdown_connections 2024-09-21T07:00:18.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.666+0000 7f3e18758640 1 --2- 172.21.15.63:0/3425083738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100b35b0 0x7f3e100b9c40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.666+0000 7f3e18758640 1 -- 172.21.15.63:0/3425083738 >> 172.21.15.63:0/3425083738 conn(0x7f3e100d4680 msgr2=0x7f3e100d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:18.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.666+0000 7f3e18758640 1 -- 172.21.15.63:0/3425083738 shutdown_connections 2024-09-21T07:00:18.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.666+0000 7f3e18758640 1 -- 172.21.15.63:0/3425083738 wait complete. 2024-09-21T07:00:18.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.668+0000 7f3e18758640 1 Processor -- start 2024-09-21T07:00:18.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.668+0000 7f3e18758640 1 -- start start 2024-09-21T07:00:18.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.669+0000 7f3e18758640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3e100b35b0 0x7f3e10160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:18.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.669+0000 7f3e18758640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e100cf6e0 0x7f3e1009e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:18.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.669+0000 7f3e18758640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100d1060 0x7f3e1009e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:18.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.669+0000 7f3e18758640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3e100d1f40 con 0x7f3e100d1060 2024-09-21T07:00:18.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.669+0000 7f3e18758640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3e100d1dc0 con 0x7f3e100cf6e0 2024-09-21T07:00:18.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.669+0000 7f3e18758640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3e100d0200 con 0x7f3e100b35b0 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.669+0000 7f3e16cf5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100d1060 0x7f3e1009e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.669+0000 7f3e16cf5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100d1060 0x7f3e1009e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43160/0 (socket says 172.21.15.63:43160) 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.669+0000 7f3e16cf5640 1 -- 172.21.15.63:0/1756607832 learned_addr learned my addr 172.21.15.63:0/1756607832 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.670+0000 7f3e164f4640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3e100b35b0 0x7f3e10160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.670+0000 7f3e15cf3640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e100cf6e0 0x7f3e1009e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.670+0000 7f3e16cf5640 1 -- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3e100b35b0 msgr2=0x7f3e10160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.670+0000 7f3e16cf5640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3e100b35b0 0x7f3e10160820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.670+0000 7f3e16cf5640 1 -- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e100cf6e0 msgr2=0x7f3e1009e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.670+0000 7f3e16cf5640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e100cf6e0 0x7f3e1009e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.670+0000 7f3e16cf5640 1 -- 172.21.15.63:0/1756607832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e100b4f60 con 0x7f3e100d1060 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.670+0000 7f3e16cf5640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100d1060 0x7f3e1009e820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c760 tx=0x7f3e0000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.670+0000 7f3e0effd640 1 -- 172.21.15.63:0/1756607832 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00003da0 con 0x7f3e100d1060 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.670+0000 7f3e0effd640 1 -- 172.21.15.63:0/1756607832 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e0000ce10 con 0x7f3e100d1060 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.670+0000 7f3e18758640 1 -- 172.21.15.63:0/1756607832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e100b5240 con 0x7f3e100d1060 2024-09-21T07:00:18.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.670+0000 7f3e0effd640 1 -- 172.21.15.63:0/1756607832 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e000052d0 con 0x7f3e100d1060 2024-09-21T07:00:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.670+0000 7f3e18758640 1 -- 172.21.15.63:0/1756607832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e100b5800 con 0x7f3e100d1060 2024-09-21T07:00:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.671+0000 7f3e18758640 1 -- 172.21.15.63:0/1756607832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e100b9c40 con 0x7f3e100d1060 2024-09-21T07:00:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.672+0000 7f3e0effd640 1 -- 172.21.15.63:0/1756607832 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3e00005470 con 0x7f3e100d1060 2024-09-21T07:00:18.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.673+0000 7f3e0effd640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3dfc078b90 0x7f3dfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.673+0000 7f3e0effd640 1 -- 172.21.15.63:0/1756607832 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f3e0009a740 con 0x7f3e100d1060 2024-09-21T07:00:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.673+0000 7f3e164f4640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3dfc078b90 0x7f3dfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:18.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.674+0000 7f3e164f4640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3dfc078b90 0x7f3dfc07b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e08034000 tx=0x7f3e08004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:18.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.677+0000 7f3e0effd640 1 -- 172.21.15.63:0/1756607832 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3e100d2e40 con 0x7f3e100d1060 2024-09-21T07:00:18.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:18.865+0000 7f3e18758640 1 -- 172.21.15.63:0/1756607832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3e1008e720 con 0x7f3e100d1060 2024-09-21T07:00:19.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.522+0000 7f3e0effd640 1 -- 172.21.15.63:0/1756607832 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f3e00062f60 con 0x7f3e100d1060 2024-09-21T07:00:19.524 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2024-09-21T07:00:19.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.525+0000 7f3e18758640 1 -- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3dfc078b90 msgr2=0x7f3dfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:19.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.525+0000 7f3e18758640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3dfc078b90 0x7f3dfc07b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e08034000 tx=0x7f3e08004730 comp rx=0 tx=0).stop 2024-09-21T07:00:19.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.525+0000 7f3e18758640 1 -- 172.21.15.63:0/1756607832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100d1060 msgr2=0x7f3e1009e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:19.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.525+0000 7f3e18758640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100d1060 0x7f3e1009e820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c760 tx=0x7f3e0000cc20 comp rx=0 tx=0).stop 2024-09-21T07:00:19.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.525+0000 7f3e18758640 1 -- 172.21.15.63:0/1756607832 shutdown_connections 2024-09-21T07:00:19.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.525+0000 7f3e18758640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3dfc078b90 0x7f3dfc07b0a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:19.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.525+0000 7f3e18758640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3e100d1060 0x7f3e1009e820 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:19.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.525+0000 7f3e18758640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e100cf6e0 0x7f3e1009e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:19.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.525+0000 7f3e18758640 1 --2- 172.21.15.63:0/1756607832 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3e100b35b0 0x7f3e10160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:19.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.525+0000 7f3e18758640 1 -- 172.21.15.63:0/1756607832 >> 172.21.15.63:0/1756607832 conn(0x7f3e100d4680 msgr2=0x7f3e100cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:19.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.526+0000 7f3e18758640 1 -- 172.21.15.63:0/1756607832 shutdown_connections 2024-09-21T07:00:19.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.526+0000 7f3e18758640 1 -- 172.21.15.63:0/1756607832 wait complete. 2024-09-21T07:00:19.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:00:19.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.675+0000 7f918e67e640 1 -- 172.21.15.63:0/3682493293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f918808c960 msgr2=0x7f91880d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:19.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.675+0000 7f918e67e640 1 --2- 172.21.15.63:0/3682493293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f918808c960 0x7f91880d1130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9180005fd0 tx=0x7f918002a820 comp rx=0 tx=0).stop 2024-09-21T07:00:19.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.675+0000 7f918e67e640 1 -- 172.21.15.63:0/3682493293 shutdown_connections 2024-09-21T07:00:19.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.675+0000 7f918e67e640 1 --2- 172.21.15.63:0/3682493293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f918808c960 0x7f91880d1130 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:19.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.675+0000 7f918e67e640 1 --2- 172.21.15.63:0/3682493293 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91880b9aa0 0x7f91880d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:19.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.675+0000 7f918e67e640 1 -- 172.21.15.63:0/3682493293 >> 172.21.15.63:0/3682493293 conn(0x7f91880d45e0 msgr2=0x7f91880d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:19.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.675+0000 7f918e67e640 1 -- 172.21.15.63:0/3682493293 shutdown_connections 2024-09-21T07:00:19.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.675+0000 7f918e67e640 1 -- 172.21.15.63:0/3682493293 wait complete. 2024-09-21T07:00:19.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.677+0000 7f918e67e640 1 Processor -- start 2024-09-21T07:00:19.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.677+0000 7f918e67e640 1 -- start start 2024-09-21T07:00:19.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f918e67e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f918808c960 0x7f91880b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:19.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f918e67e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91880b3aa0 0x7f91880b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:19.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f918e67e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91880b9aa0 0x7f91880b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:19.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f918e67e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f918806ecc0 con 0x7f91880b3aa0 2024-09-21T07:00:19.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f918e67e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f918806eb40 con 0x7f918808c960 2024-09-21T07:00:19.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f918e67e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f918806ee40 con 0x7f91880b9aa0 2024-09-21T07:00:19.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f91877fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91880b3aa0 0x7f91880b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:19.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f91877fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91880b3aa0 0x7f91880b4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43172/0 (socket says 172.21.15.63:43172) 2024-09-21T07:00:19.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f91877fe640 1 -- 172.21.15.63:0/511775273 learned_addr learned my addr 172.21.15.63:0/511775273 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:19.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f9187fff640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f918808c960 0x7f91880b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:19.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f918cc1b640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91880b9aa0 0x7f91880b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:19.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f91877fe640 1 -- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91880b9aa0 msgr2=0x7f91880b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:19.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f91877fe640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91880b9aa0 0x7f91880b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:19.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f91877fe640 1 -- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f918808c960 msgr2=0x7f91880b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:19.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f91877fe640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f918808c960 0x7f91880b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:19.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f91877fe640 1 -- 172.21.15.63:0/511775273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9188161580 con 0x7f91880b3aa0 2024-09-21T07:00:19.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f91877fe640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91880b3aa0 0x7f91880b4f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f917c00e9c0 tx=0x7f917c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:19.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.679+0000 7f9184ff9640 1 -- 172.21.15.63:0/511775273 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c00cd80 con 0x7f91880b3aa0 2024-09-21T07:00:19.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.680+0000 7f9184ff9640 1 -- 172.21.15.63:0/511775273 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f917c004020 con 0x7f91880b3aa0 2024-09-21T07:00:19.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.680+0000 7f918e67e640 1 -- 172.21.15.63:0/511775273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f918815f430 con 0x7f91880b3aa0 2024-09-21T07:00:19.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.680+0000 7f9184ff9640 1 -- 172.21.15.63:0/511775273 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c004450 con 0x7f91880b3aa0 2024-09-21T07:00:19.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.680+0000 7f918e67e640 1 -- 172.21.15.63:0/511775273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f918815ee70 con 0x7f91880b3aa0 2024-09-21T07:00:19.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.681+0000 7f918e67e640 1 -- 172.21.15.63:0/511775273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91880cbef0 con 0x7f91880b3aa0 2024-09-21T07:00:19.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.681+0000 7f9184ff9640 1 -- 172.21.15.63:0/511775273 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f917c0035f0 con 0x7f91880b3aa0 2024-09-21T07:00:19.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.682+0000 7f9184ff9640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f9174078bc0 0x7f917407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:19.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.682+0000 7f9184ff9640 1 -- 172.21.15.63:0/511775273 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f917c09b380 con 0x7f91880b3aa0 2024-09-21T07:00:19.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.682+0000 7f9187fff640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f9174078bc0 0x7f917407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:19.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.683+0000 7f9187fff640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f9174078bc0 0x7f917407b0d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9178007fd0 tx=0x7f9178009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:19.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.687+0000 7f9184ff9640 1 -- 172.21.15.63:0/511775273 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f917c0633e0 con 0x7f91880b3aa0 2024-09-21T07:00:19.876 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:19.874+0000 7f918e67e640 1 -- 172.21.15.63:0/511775273 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f918806f2f0 con 0x7f91880b3aa0 2024-09-21T07:00:20.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.530+0000 7f9184ff9640 1 -- 172.21.15.63:0/511775273 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7f917c067e10 con 0x7f91880b3aa0 2024-09-21T07:00:20.532 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2024-09-21T07:00:20.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.533+0000 7f918e67e640 1 -- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f9174078bc0 msgr2=0x7f917407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:20.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.533+0000 7f918e67e640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f9174078bc0 0x7f917407b0d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9178007fd0 tx=0x7f9178009040 comp rx=0 tx=0).stop 2024-09-21T07:00:20.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.533+0000 7f918e67e640 1 -- 172.21.15.63:0/511775273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91880b3aa0 msgr2=0x7f91880b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:20.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.533+0000 7f918e67e640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91880b3aa0 0x7f91880b4f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f917c00e9c0 tx=0x7f917c00ee80 comp rx=0 tx=0).stop 2024-09-21T07:00:20.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.533+0000 7f918e67e640 1 -- 172.21.15.63:0/511775273 shutdown_connections 2024-09-21T07:00:20.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.533+0000 7f918e67e640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f9174078bc0 0x7f917407b0d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:20.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.533+0000 7f918e67e640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91880b9aa0 0x7f91880b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:20.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.533+0000 7f918e67e640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91880b3aa0 0x7f91880b4f30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:20.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.533+0000 7f918e67e640 1 --2- 172.21.15.63:0/511775273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f918808c960 0x7f91880b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:20.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.533+0000 7f918e67e640 1 -- 172.21.15.63:0/511775273 >> 172.21.15.63:0/511775273 conn(0x7f91880d45e0 msgr2=0x7f91880d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:20.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.534+0000 7f918e67e640 1 -- 172.21.15.63:0/511775273 shutdown_connections 2024-09-21T07:00:20.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.534+0000 7f918e67e640 1 -- 172.21.15.63:0/511775273 wait complete. 2024-09-21T07:00:20.566 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:00:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.685+0000 7f705e74a640 1 -- 172.21.15.63:0/2838813830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70580b1a40 msgr2=0x7f70580b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.685+0000 7f705e74a640 1 --2- 172.21.15.63:0/2838813830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70580b1a40 0x7f70580b1e50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f704c005fd0 tx=0x7f704c02a670 comp rx=0 tx=0).stop 2024-09-21T07:00:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.685+0000 7f705e74a640 1 -- 172.21.15.63:0/2838813830 shutdown_connections 2024-09-21T07:00:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.685+0000 7f705e74a640 1 --2- 172.21.15.63:0/2838813830 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70580cce80 0x7f70580cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.685+0000 7f705e74a640 1 --2- 172.21.15.63:0/2838813830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70580b1a40 0x7f70580b1e50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.685+0000 7f705e74a640 1 -- 172.21.15.63:0/2838813830 >> 172.21.15.63:0/2838813830 conn(0x7f70580b3050 msgr2=0x7f70580b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.685+0000 7f705e74a640 1 -- 172.21.15.63:0/2838813830 shutdown_connections 2024-09-21T07:00:20.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.685+0000 7f705e74a640 1 -- 172.21.15.63:0/2838813830 wait complete. 2024-09-21T07:00:20.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.686+0000 7f705e74a640 1 Processor -- start 2024-09-21T07:00:20.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.687+0000 7f705e74a640 1 -- start start 2024-09-21T07:00:20.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f705e74a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70580b1a40 0x7f70580b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:20.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f705e74a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70580b3b70 0x7f705809cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:20.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f705e74a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70580cce80 0x7f705809d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:20.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f705e74a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f705806d330 con 0x7f70580b1a40 2024-09-21T07:00:20.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f705e74a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f705806d1b0 con 0x7f70580b3b70 2024-09-21T07:00:20.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f705e74a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f705806d4b0 con 0x7f70580cce80 2024-09-21T07:00:20.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f7057fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70580b1a40 0x7f70580b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:20.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f7057fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70580b1a40 0x7f70580b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43184/0 (socket says 172.21.15.63:43184) 2024-09-21T07:00:20.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f7057fff640 1 -- 172.21.15.63:0/1243782002 learned_addr learned my addr 172.21.15.63:0/1243782002 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:20.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f70577fe640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70580b3b70 0x7f705809cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:20.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f705cce7640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70580cce80 0x7f705809d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:20.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f7057fff640 1 -- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70580cce80 msgr2=0x7f705809d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:20.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f7057fff640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70580cce80 0x7f705809d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:20.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f7057fff640 1 -- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70580b3b70 msgr2=0x7f705809cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:20.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f7057fff640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70580b3b70 0x7f705809cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:20.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.688+0000 7f7057fff640 1 -- 172.21.15.63:0/1243782002 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70581f3590 con 0x7f70580b1a40 2024-09-21T07:00:20.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.689+0000 7f7057fff640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70580b1a40 0x7f70580b00c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f704800c420 tx=0x7f704800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:20.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.689+0000 7f7054ff9640 1 -- 172.21.15.63:0/1243782002 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7048017070 con 0x7f70580b1a40 2024-09-21T07:00:20.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.689+0000 7f7054ff9640 1 -- 172.21.15.63:0/1243782002 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70480035f0 con 0x7f70580b1a40 2024-09-21T07:00:20.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.689+0000 7f705e74a640 1 -- 172.21.15.63:0/1243782002 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70581f3870 con 0x7f70580b1a40 2024-09-21T07:00:20.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.689+0000 7f7054ff9640 1 -- 172.21.15.63:0/1243782002 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7048003a40 con 0x7f70580b1a40 2024-09-21T07:00:20.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.689+0000 7f705e74a640 1 -- 172.21.15.63:0/1243782002 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70581f3e30 con 0x7f70580b1a40 2024-09-21T07:00:20.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.690+0000 7f705e74a640 1 -- 172.21.15.63:0/1243782002 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70580cc3c0 con 0x7f70580b1a40 2024-09-21T07:00:20.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.691+0000 7f7054ff9640 1 -- 172.21.15.63:0/1243782002 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f704801a070 con 0x7f70580b1a40 2024-09-21T07:00:20.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.691+0000 7f7054ff9640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7044078bc0 0x7f704407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:20.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.691+0000 7f7054ff9640 1 -- 172.21.15.63:0/1243782002 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f7048099e70 con 0x7f70580b1a40 2024-09-21T07:00:20.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.691+0000 7f70577fe640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7044078bc0 0x7f704407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:20.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.692+0000 7f70577fe640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7044078bc0 0x7f704407b0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f704c033000 tx=0x7f704c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.696+0000 7f7054ff9640 1 -- 172.21.15.63:0/1243782002 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f70580cc3c0 con 0x7f70580b1a40 2024-09-21T07:00:20.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:20.921+0000 7f705e74a640 1 -- 172.21.15.63:0/1243782002 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f705806d960 con 0x7f70580b1a40 2024-09-21T07:00:21.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.533+0000 7f7054ff9640 1 -- 172.21.15.63:0/1243782002 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f7048061d50 con 0x7f70580b1a40 2024-09-21T07:00:21.535 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T07:00:21.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.538+0000 7f705e74a640 1 -- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7044078bc0 msgr2=0x7f704407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:21.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.538+0000 7f705e74a640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7044078bc0 0x7f704407b0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f704c033000 tx=0x7f704c004730 comp rx=0 tx=0).stop 2024-09-21T07:00:21.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.538+0000 7f705e74a640 1 -- 172.21.15.63:0/1243782002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70580b1a40 msgr2=0x7f70580b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:21.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.538+0000 7f705e74a640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70580b1a40 0x7f70580b00c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f704800c420 tx=0x7f704800c8e0 comp rx=0 tx=0).stop 2024-09-21T07:00:21.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.538+0000 7f705e74a640 1 -- 172.21.15.63:0/1243782002 shutdown_connections 2024-09-21T07:00:21.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.538+0000 7f705e74a640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7044078bc0 0x7f704407b0d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:21.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.538+0000 7f705e74a640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f70580cce80 0x7f705809d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:21.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.538+0000 7f705e74a640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f70580b3b70 0x7f705809cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:21.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.538+0000 7f705e74a640 1 --2- 172.21.15.63:0/1243782002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f70580b1a40 0x7f70580b00c0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f704800c420 tx=0x7f704800c8e0 comp rx=0 tx=0).stop 2024-09-21T07:00:21.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.538+0000 7f705e74a640 1 -- 172.21.15.63:0/1243782002 >> 172.21.15.63:0/1243782002 conn(0x7f70580b3050 msgr2=0x7f7058155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:21.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.538+0000 7f705e74a640 1 -- 172.21.15.63:0/1243782002 shutdown_connections 2024-09-21T07:00:21.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.539+0000 7f705e74a640 1 -- 172.21.15.63:0/1243782002 wait complete. 2024-09-21T07:00:21.575 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:00:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.693+0000 7f4667b2b640 1 -- 172.21.15.63:0/1025563839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f464c004e60 msgr2=0x7f464c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.693+0000 7f4667b2b640 1 --2- 172.21.15.63:0/1025563839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f464c004e60 0x7f464c00b9c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4658001d90 tx=0x7f464c005830 comp rx=0 tx=0).stop 2024-09-21T07:00:21.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.693+0000 7f46660c8640 1 -- 172.21.15.63:0/1025563839 reap_dead start 2024-09-21T07:00:21.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.693+0000 7f4667b2b640 1 -- 172.21.15.63:0/1025563839 shutdown_connections 2024-09-21T07:00:21.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.693+0000 7f4667b2b640 1 -- 172.21.15.63:0/1025563839 >> 172.21.15.63:0/1025563839 conn(0x7f466008bfd0 msgr2=0x7f46600d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:21.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.693+0000 7f4667b2b640 1 -- 172.21.15.63:0/1025563839 shutdown_connections 2024-09-21T07:00:21.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.693+0000 7f4667b2b640 1 -- 172.21.15.63:0/1025563839 wait complete. 2024-09-21T07:00:21.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.695+0000 7f4667b2b640 1 Processor -- start 2024-09-21T07:00:21.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.695+0000 7f4667b2b640 1 -- start start 2024-09-21T07:00:21.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.696+0000 7f4667b2b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f464c004e60 0x7f4660160170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:21.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.696+0000 7f4667b2b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46601f5010 0x7f46601f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:21.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.696+0000 7f4667b2b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46600b5020 0x7f46600ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:21.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.696+0000 7f4667b2b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f46600cfe30 con 0x7f464c004e60 2024-09-21T07:00:21.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.696+0000 7f4667b2b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46600d2790 con 0x7f46601f5010 2024-09-21T07:00:21.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.696+0000 7f4667b2b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f46600cffb0 con 0x7f46600b5020 2024-09-21T07:00:21.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.696+0000 7f46658c7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f464c004e60 0x7f4660160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:21.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.696+0000 7f46658c7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f464c004e60 0x7f4660160170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43200/0 (socket says 172.21.15.63:43200) 2024-09-21T07:00:21.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.696+0000 7f46658c7640 1 -- 172.21.15.63:0/3050920739 learned_addr learned my addr 172.21.15.63:0/3050920739 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:21.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.697+0000 7f46660c8640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46600b5020 0x7f46600ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:21.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.697+0000 7f46650c6640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46601f5010 0x7f46601f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:21.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.697+0000 7f46658c7640 1 -- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46600b5020 msgr2=0x7f46600ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:21.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.697+0000 7f46658c7640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46600b5020 0x7f46600ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:21.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.697+0000 7f46658c7640 1 -- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46601f5010 msgr2=0x7f46601f95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:21.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.697+0000 7f46658c7640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46601f5010 0x7f46601f95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:21.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.697+0000 7f46658c7640 1 -- 172.21.15.63:0/3050920739 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46601620a0 con 0x7f464c004e60 2024-09-21T07:00:21.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.697+0000 7f46658c7640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f464c004e60 0x7f4660160170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4654011b10 tx=0x7f4654009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:21.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.697+0000 7f46527fc640 1 -- 172.21.15.63:0/3050920739 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465401e070 con 0x7f464c004e60 2024-09-21T07:00:21.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.697+0000 7f46527fc640 1 -- 172.21.15.63:0/3050920739 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f465400fd00 con 0x7f464c004e60 2024-09-21T07:00:21.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.697+0000 7f46527fc640 1 -- 172.21.15.63:0/3050920739 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654019670 con 0x7f464c004e60 2024-09-21T07:00:21.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.697+0000 7f4667b2b640 1 -- 172.21.15.63:0/3050920739 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4660162380 con 0x7f464c004e60 2024-09-21T07:00:21.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.697+0000 7f4667b2b640 1 -- 172.21.15.63:0/3050920739 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46601f9080 con 0x7f464c004e60 2024-09-21T07:00:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.698+0000 7f4667b2b640 1 -- 172.21.15.63:0/3050920739 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4660161bc0 con 0x7f464c004e60 2024-09-21T07:00:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.699+0000 7f46527fc640 1 -- 172.21.15.63:0/3050920739 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4654021070 con 0x7f464c004e60 2024-09-21T07:00:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.699+0000 7f46527fc640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4644078b90 0x7f464407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.699+0000 7f46527fc640 1 -- 172.21.15.63:0/3050920739 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f465409b650 con 0x7f464c004e60 2024-09-21T07:00:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.700+0000 7f46650c6640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4644078b90 0x7f464407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:21.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.700+0000 7f46650c6640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4644078b90 0x7f464407b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f466015bda0 tx=0x7f465c0067a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:21.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.704+0000 7f46527fc640 1 -- 172.21.15.63:0/3050920739 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4660161bc0 con 0x7f464c004e60 2024-09-21T07:00:21.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.892+0000 7f4667b2b640 1 -- 172.21.15.63:0/3050920739 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46600d0540 con 0x7f464c004e60 2024-09-21T07:00:21.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.893+0000 7f46527fc640 1 -- 172.21.15.63:0/3050920739 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16634 (secure 0 0 0) 0x7f4654063440 con 0x7f464c004e60 2024-09-21T07:00:21.895 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:21.895 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":21,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:00:20.923066+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:00:18.869431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:00:19.879189+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:00:21.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.895+0000 7f4667b2b640 1 -- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4644078b90 msgr2=0x7f464407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:21.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.895+0000 7f4667b2b640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4644078b90 0x7f464407b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f466015bda0 tx=0x7f465c0067a0 comp rx=0 tx=0).stop 2024-09-21T07:00:21.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.895+0000 7f4667b2b640 1 -- 172.21.15.63:0/3050920739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f464c004e60 msgr2=0x7f4660160170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:21.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.895+0000 7f4667b2b640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f464c004e60 0x7f4660160170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4654011b10 tx=0x7f4654009ee0 comp rx=0 tx=0).stop 2024-09-21T07:00:21.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.895+0000 7f4667b2b640 1 -- 172.21.15.63:0/3050920739 shutdown_connections 2024-09-21T07:00:21.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.895+0000 7f4667b2b640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4644078b90 0x7f464407b0a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:21.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.895+0000 7f4667b2b640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f46600b5020 0x7f46600ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:21.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.895+0000 7f4667b2b640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46601f5010 0x7f46601f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:21.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.895+0000 7f4667b2b640 1 --2- 172.21.15.63:0/3050920739 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f464c004e60 0x7f4660160170 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:21.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.895+0000 7f4667b2b640 1 -- 172.21.15.63:0/3050920739 >> 172.21.15.63:0/3050920739 conn(0x7f466008bfd0 msgr2=0x7f4660075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:21.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.895+0000 7f4667b2b640 1 -- 172.21.15.63:0/3050920739 shutdown_connections 2024-09-21T07:00:21.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:21.895+0000 7f4667b2b640 1 -- 172.21.15.63:0/3050920739 wait complete. 2024-09-21T07:00:21.908 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:00:22.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.022+0000 7fd66fd19640 1 -- 172.21.15.63:0/905306691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6680d5100 msgr2=0x7fd6680b95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:22.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.022+0000 7fd66fd19640 1 --2- 172.21.15.63:0/905306691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6680d5100 0x7fd6680b95e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd664009820 tx=0x7fd66402a510 comp rx=0 tx=0).stop 2024-09-21T07:00:22.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.022+0000 7fd66fd19640 1 -- 172.21.15.63:0/905306691 shutdown_connections 2024-09-21T07:00:22.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.022+0000 7fd66fd19640 1 --2- 172.21.15.63:0/905306691 >> v2:172.21.15.71:3300/0 conn(0x7fd66806e330 0x7fd6680d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.022+0000 7fd66fd19640 1 --2- 172.21.15.63:0/905306691 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6680d5100 0x7fd6680b95e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.022+0000 7fd66fd19640 1 -- 172.21.15.63:0/905306691 >> 172.21.15.63:0/905306691 conn(0x7fd6680d45e0 msgr2=0x7fd6680d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:22.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.023+0000 7fd66fd19640 1 -- 172.21.15.63:0/905306691 shutdown_connections 2024-09-21T07:00:22.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.023+0000 7fd66fd19640 1 -- 172.21.15.63:0/905306691 wait complete. 2024-09-21T07:00:22.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.024+0000 7fd66fd19640 1 Processor -- start 2024-09-21T07:00:22.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.024+0000 7fd66fd19640 1 -- start start 2024-09-21T07:00:22.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66fd19640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd66806df20 0x7fd6680ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:22.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66fd19640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66806e330 0x7fd668154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:22.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66fd19640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6680d5100 0x7fd6680b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:22.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66fd19640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd6680d0720 con 0x7fd6680d5100 2024-09-21T07:00:22.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66fd19640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd6680d05a0 con 0x7fd66806e330 2024-09-21T07:00:22.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66fd19640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd6680d1530 con 0x7fd66806df20 2024-09-21T07:00:22.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66e2b6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6680d5100 0x7fd6680b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:22.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66e2b6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6680d5100 0x7fd6680b8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43214/0 (socket says 172.21.15.63:43214) 2024-09-21T07:00:22.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66e2b6640 1 -- 172.21.15.63:0/917327168 learned_addr learned my addr 172.21.15.63:0/917327168 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:22.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66dab5640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd66806df20 0x7fd6680ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:22.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66d2b4640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66806e330 0x7fd668154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:22.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66e2b6640 1 -- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd66806df20 msgr2=0x7fd6680ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:22.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66e2b6640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd66806df20 0x7fd6680ce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66e2b6640 1 -- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66806e330 msgr2=0x7fd668154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:22.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66e2b6640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66806e330 0x7fd668154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66e2b6640 1 -- 172.21.15.63:0/917327168 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66815cd20 con 0x7fd6680d5100 2024-09-21T07:00:22.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd66e2b6640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6680d5100 0x7fd6680b8420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd66000ea40 tx=0x7fd66000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:22.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd65e7fc640 1 -- 172.21.15.63:0/917327168 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66000ce40 con 0x7fd6680d5100 2024-09-21T07:00:22.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd65e7fc640 1 -- 172.21.15.63:0/917327168 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd660004c10 con 0x7fd6680d5100 2024-09-21T07:00:22.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.026+0000 7fd65e7fc640 1 -- 172.21.15.63:0/917327168 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd660005020 con 0x7fd6680d5100 2024-09-21T07:00:22.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.027+0000 7fd66fd19640 1 -- 172.21.15.63:0/917327168 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6680c8320 con 0x7fd6680d5100 2024-09-21T07:00:22.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.027+0000 7fd66fd19640 1 -- 172.21.15.63:0/917327168 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd668161d40 con 0x7fd6680d5100 2024-09-21T07:00:22.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.027+0000 7fd66fd19640 1 -- 172.21.15.63:0/917327168 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6681f6a30 con 0x7fd6680d5100 2024-09-21T07:00:22.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.028+0000 7fd65e7fc640 1 -- 172.21.15.63:0/917327168 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd6600051c0 con 0x7fd6680d5100 2024-09-21T07:00:22.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.029+0000 7fd65e7fc640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd64c078bc0 0x7fd64c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:22.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.029+0000 7fd65e7fc640 1 -- 172.21.15.63:0/917327168 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd66009bb60 con 0x7fd6680d5100 2024-09-21T07:00:22.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.029+0000 7fd66dab5640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd64c078bc0 0x7fd64c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:22.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.030+0000 7fd66dab5640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd64c078bc0 0x7fd64c07b0d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd664034000 tx=0x7fd664004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:22.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.033+0000 7fd65e7fc640 1 -- 172.21.15.63:0/917327168 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd66815cd20 con 0x7fd6680d5100 2024-09-21T07:00:22.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.220+0000 7fd66fd19640 1 -- 172.21.15.63:0/917327168 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6680d2cd0 con 0x7fd6680d5100 2024-09-21T07:00:22.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.221+0000 7fd65e7fc640 1 -- 172.21.15.63:0/917327168 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16634 (secure 0 0 0) 0x7fd660063fa0 con 0x7fd6680d5100 2024-09-21T07:00:22.223 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:22.223 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":21,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:00:20.923066+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:00:18.869431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:00:19.879189+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:00:22.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.223+0000 7fd66fd19640 1 -- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd64c078bc0 msgr2=0x7fd64c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:22.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.223+0000 7fd66fd19640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd64c078bc0 0x7fd64c07b0d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd664034000 tx=0x7fd664004730 comp rx=0 tx=0).stop 2024-09-21T07:00:22.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.223+0000 7fd66fd19640 1 -- 172.21.15.63:0/917327168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6680d5100 msgr2=0x7fd6680b8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:22.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.223+0000 7fd66fd19640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6680d5100 0x7fd6680b8420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd66000ea40 tx=0x7fd66000ef00 comp rx=0 tx=0).stop 2024-09-21T07:00:22.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.223+0000 7fd66fd19640 1 -- 172.21.15.63:0/917327168 shutdown_connections 2024-09-21T07:00:22.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.223+0000 7fd66fd19640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd64c078bc0 0x7fd64c07b0d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.223+0000 7fd66fd19640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6680d5100 0x7fd6680b8420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.223+0000 7fd66fd19640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd66806e330 0x7fd668154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.223+0000 7fd66fd19640 1 --2- 172.21.15.63:0/917327168 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd66806df20 0x7fd6680ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.223+0000 7fd66fd19640 1 -- 172.21.15.63:0/917327168 >> 172.21.15.63:0/917327168 conn(0x7fd6680d45e0 msgr2=0x7fd6680b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:22.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.223+0000 7fd66fd19640 1 -- 172.21.15.63:0/917327168 shutdown_connections 2024-09-21T07:00:22.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.223+0000 7fd66fd19640 1 -- 172.21.15.63:0/917327168 wait complete. 2024-09-21T07:00:22.236 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:00:22.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.353+0000 7fbe6b04a640 1 -- 172.21.15.63:0/3894716687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe640b7530 msgr2=0x7fbe640d2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:22.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.353+0000 7fbe6b04a640 1 --2- 172.21.15.63:0/3894716687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe640b7530 0x7fbe640d2530 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbe640ba3a0 tx=0x7fbe5402a5f0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.353+0000 7fbe6b04a640 1 -- 172.21.15.63:0/3894716687 shutdown_connections 2024-09-21T07:00:22.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.353+0000 7fbe6b04a640 1 --2- 172.21.15.63:0/3894716687 >> v2:172.21.15.71:3300/0 conn(0x7fbe640cf310 0x7fbe640cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.353+0000 7fbe6b04a640 1 --2- 172.21.15.63:0/3894716687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe640b7530 0x7fbe640d2530 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.353+0000 7fbe6b04a640 1 -- 172.21.15.63:0/3894716687 >> 172.21.15.63:0/3894716687 conn(0x7fbe6408bfd0 msgr2=0x7fbe640d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:22.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.353+0000 7fbe6b04a640 1 -- 172.21.15.63:0/3894716687 shutdown_connections 2024-09-21T07:00:22.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.353+0000 7fbe6b04a640 1 -- 172.21.15.63:0/3894716687 wait complete. 2024-09-21T07:00:22.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.355+0000 7fbe6b04a640 1 Processor -- start 2024-09-21T07:00:22.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.355+0000 7fbe6b04a640 1 -- start start 2024-09-21T07:00:22.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.356+0000 7fbe6b04a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe640b7530 0x7fbe641f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:22.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.356+0000 7fbe6b04a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe640cf310 0x7fbe640b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:22.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.356+0000 7fbe6b04a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe6415ef00 0x7fbe640b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.356+0000 7fbe6b04a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbe640cfff0 con 0x7fbe640cf310 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.356+0000 7fbe6b04a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbe640cfe70 con 0x7fbe640b7530 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.356+0000 7fbe6b04a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbe640d0170 con 0x7fbe6415ef00 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe63fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe640cf310 0x7fbe640b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe63fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe640cf310 0x7fbe640b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43238/0 (socket says 172.21.15.63:43238) 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe63fff640 1 -- 172.21.15.63:0/4020500449 learned_addr learned my addr 172.21.15.63:0/4020500449 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe695e7640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe6415ef00 0x7fbe640b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe68de6640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe640b7530 0x7fbe641f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe63fff640 1 -- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe6415ef00 msgr2=0x7fbe640b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe63fff640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe6415ef00 0x7fbe640b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe63fff640 1 -- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe640b7530 msgr2=0x7fbe641f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe63fff640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe640b7530 0x7fbe641f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe63fff640 1 -- 172.21.15.63:0/4020500449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe640cb7c0 con 0x7fbe640cf310 2024-09-21T07:00:22.360 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe63fff640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe640cf310 0x7fbe640b4bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800c430 tx=0x7fbe5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:22.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe617fa640 1 -- 172.21.15.63:0/4020500449 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58017070 con 0x7fbe640cf310 2024-09-21T07:00:22.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe617fa640 1 -- 172.21.15.63:0/4020500449 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe580053c0 con 0x7fbe640cf310 2024-09-21T07:00:22.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe6b04a640 1 -- 172.21.15.63:0/4020500449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe640cbaa0 con 0x7fbe640cf310 2024-09-21T07:00:22.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe617fa640 1 -- 172.21.15.63:0/4020500449 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58003850 con 0x7fbe640cf310 2024-09-21T07:00:22.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.357+0000 7fbe6b04a640 1 -- 172.21.15.63:0/4020500449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe640cc060 con 0x7fbe640cf310 2024-09-21T07:00:22.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.358+0000 7fbe6b04a640 1 -- 172.21.15.63:0/4020500449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe640d0670 con 0x7fbe640cf310 2024-09-21T07:00:22.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.359+0000 7fbe617fa640 1 -- 172.21.15.63:0/4020500449 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe5801a070 con 0x7fbe640cf310 2024-09-21T07:00:22.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.360+0000 7fbe617fa640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbe50078b90 0x7fbe5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:22.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.360+0000 7fbe617fa640 1 -- 172.21.15.63:0/4020500449 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbe58099f70 con 0x7fbe640cf310 2024-09-21T07:00:22.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.360+0000 7fbe68de6640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbe50078b90 0x7fbe5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:22.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.361+0000 7fbe68de6640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbe50078b90 0x7fbe5007b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbe54034000 tx=0x7fbe54004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:22.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.364+0000 7fbe617fa640 1 -- 172.21.15.63:0/4020500449 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbe58061e80 con 0x7fbe640cf310 2024-09-21T07:00:22.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:22.594+0000 7fbe6b04a640 1 -- 172.21.15.63:0/4020500449 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbe64161a90 con 0x7fbe640cf310 2024-09-21T07:00:23.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.567+0000 7fbe617fa640 1 -- 172.21.15.63:0/4020500449 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fbe580668b0 con 0x7fbe640cf310 2024-09-21T07:00:23.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.570+0000 7fbe6b04a640 1 -- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbe50078b90 msgr2=0x7fbe5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:23.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.570+0000 7fbe6b04a640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbe50078b90 0x7fbe5007b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbe54034000 tx=0x7fbe54004730 comp rx=0 tx=0).stop 2024-09-21T07:00:23.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.570+0000 7fbe6b04a640 1 -- 172.21.15.63:0/4020500449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe640cf310 msgr2=0x7fbe640b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:23.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.570+0000 7fbe6b04a640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe640cf310 0x7fbe640b4bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800c430 tx=0x7fbe5800c8f0 comp rx=0 tx=0).stop 2024-09-21T07:00:23.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.570+0000 7fbe6b04a640 1 -- 172.21.15.63:0/4020500449 shutdown_connections 2024-09-21T07:00:23.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.570+0000 7fbe6b04a640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbe50078b90 0x7fbe5007b0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:23.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.570+0000 7fbe6b04a640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe6415ef00 0x7fbe640b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:23.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.570+0000 7fbe6b04a640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe640cf310 0x7fbe640b4bf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:23.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.570+0000 7fbe6b04a640 1 --2- 172.21.15.63:0/4020500449 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe640b7530 0x7fbe641f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:23.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.570+0000 7fbe6b04a640 1 -- 172.21.15.63:0/4020500449 >> 172.21.15.63:0/4020500449 conn(0x7fbe6408bfd0 msgr2=0x7fbe6415ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:23.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.570+0000 7fbe6b04a640 1 -- 172.21.15.63:0/4020500449 shutdown_connections 2024-09-21T07:00:23.573 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.571+0000 7fbe6b04a640 1 -- 172.21.15.63:0/4020500449 wait complete. 2024-09-21T07:00:23.586 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:00:23.586 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:00:23.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.711+0000 7f79b0c07640 1 -- 172.21.15.63:0/3750392033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79ac08c960 msgr2=0x7f79ac0d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:23.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.711+0000 7f79b0c07640 1 --2- 172.21.15.63:0/3750392033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79ac08c960 0x7f79ac0d0c00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f799c005fd0 tx=0x7f799c02aab0 comp rx=0 tx=0).stop 2024-09-21T07:00:23.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.711+0000 7f79b0c07640 1 -- 172.21.15.63:0/3750392033 shutdown_connections 2024-09-21T07:00:23.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.711+0000 7f79b0c07640 1 --2- 172.21.15.63:0/3750392033 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79ac08c960 0x7f79ac0d0c00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:23.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.711+0000 7f79b0c07640 1 -- 172.21.15.63:0/3750392033 >> 172.21.15.63:0/3750392033 conn(0x7f79ac0d4580 msgr2=0x7f79ac0d4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:23.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.711+0000 7f79b0c07640 1 -- 172.21.15.63:0/3750392033 shutdown_connections 2024-09-21T07:00:23.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.711+0000 7f79b0c07640 1 -- 172.21.15.63:0/3750392033 wait complete. 2024-09-21T07:00:23.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.713+0000 7f79b0c07640 1 Processor -- start 2024-09-21T07:00:23.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.713+0000 7f79b0c07640 1 -- start start 2024-09-21T07:00:23.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.714+0000 7f79b0c07640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79ac08c960 0x7f79ac0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:23.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.714+0000 7f79b0c07640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ac0b9de0 0x7f79ac1616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.714+0000 7f79b0c07640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f79ac0d0180 0x7f79ac1f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.714+0000 7f79b0c07640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac06f880 con 0x7f79ac08c960 2024-09-21T07:00:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.714+0000 7f79b0c07640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac06f700 con 0x7f79ac0b9de0 2024-09-21T07:00:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.714+0000 7f79b0c07640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f79ac0d1140 con 0x7f79ac0d0180 2024-09-21T07:00:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.714+0000 7f79aa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79ac08c960 0x7f79ac0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f79aa59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79ac08c960 0x7f79ac0b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43264/0 (socket says 172.21.15.63:43264) 2024-09-21T07:00:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f79aa59c640 1 -- 172.21.15.63:0/4024762706 learned_addr learned my addr 172.21.15.63:0/4024762706 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f79a9d9b640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ac0b9de0 0x7f79ac1616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f79aad9d640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f79ac0d0180 0x7f79ac1f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f79aa59c640 1 -- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f79ac0d0180 msgr2=0x7f79ac1f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f79aa59c640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f79ac0d0180 0x7f79ac1f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f79aa59c640 1 -- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ac0b9de0 msgr2=0x7f79ac1616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:23.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f79aa59c640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ac0b9de0 0x7f79ac1616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:23.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f79aa59c640 1 -- 172.21.15.63:0/4024762706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac1f6550 con 0x7f79ac08c960 2024-09-21T07:00:23.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f79aad9d640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f79ac0d0180 0x7f79ac1f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:23.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f79aa59c640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79ac08c960 0x7f79ac0b5000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f799c000f80 tx=0x7f799c030f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:23.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f799affd640 1 -- 172.21.15.63:0/4024762706 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c004b40 con 0x7f79ac08c960 2024-09-21T07:00:23.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f799affd640 1 -- 172.21.15.63:0/4024762706 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f799c004ce0 con 0x7f79ac08c960 2024-09-21T07:00:23.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f79b0c07640 1 -- 172.21.15.63:0/4024762706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ac160bc0 con 0x7f79ac08c960 2024-09-21T07:00:23.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f799affd640 1 -- 172.21.15.63:0/4024762706 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c0044b0 con 0x7f79ac08c960 2024-09-21T07:00:23.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.715+0000 7f79b0c07640 1 -- 172.21.15.63:0/4024762706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ac161180 con 0x7f79ac08c960 2024-09-21T07:00:23.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.716+0000 7f79b0c07640 1 -- 172.21.15.63:0/4024762706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ac0d0c00 con 0x7f79ac08c960 2024-09-21T07:00:23.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.717+0000 7f799affd640 1 -- 172.21.15.63:0/4024762706 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f799c00c040 con 0x7f79ac08c960 2024-09-21T07:00:23.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.718+0000 7f799affd640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f798c078bc0 0x7f798c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:23.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.718+0000 7f799affd640 1 -- 172.21.15.63:0/4024762706 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f799c0bbbc0 con 0x7f79ac08c960 2024-09-21T07:00:23.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.718+0000 7f79a9d9b640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f798c078bc0 0x7f798c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:23.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.718+0000 7f79a9d9b640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f798c078bc0 0x7f798c07b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f79a0000fb0 tx=0x7f79a0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:23.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.722+0000 7f799affd640 1 -- 172.21.15.63:0/4024762706 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f799c032030 con 0x7f79ac08c960 2024-09-21T07:00:23.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:23.947+0000 7f79b0c07640 1 -- 172.21.15.63:0/4024762706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f79ac0ce530 con 0x7f79ac08c960 2024-09-21T07:00:24.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.572+0000 7f799affd640 1 -- 172.21.15.63:0/4024762706 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f799c0839b0 con 0x7f79ac08c960 2024-09-21T07:00:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.575+0000 7f79b0c07640 1 -- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f798c078bc0 msgr2=0x7f798c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.575+0000 7f79b0c07640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f798c078bc0 0x7f798c07b0d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f79a0000fb0 tx=0x7f79a0009040 comp rx=0 tx=0).stop 2024-09-21T07:00:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.575+0000 7f79b0c07640 1 -- 172.21.15.63:0/4024762706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79ac08c960 msgr2=0x7f79ac0b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.575+0000 7f79b0c07640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79ac08c960 0x7f79ac0b5000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f799c000f80 tx=0x7f799c030f00 comp rx=0 tx=0).stop 2024-09-21T07:00:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.575+0000 7f79b0c07640 1 -- 172.21.15.63:0/4024762706 shutdown_connections 2024-09-21T07:00:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.575+0000 7f79b0c07640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f798c078bc0 0x7f798c07b0d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.575+0000 7f79b0c07640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f79ac0d0180 0x7f79ac1f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.575+0000 7f79b0c07640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79ac0b9de0 0x7f79ac1616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.575+0000 7f79b0c07640 1 --2- 172.21.15.63:0/4024762706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79ac08c960 0x7f79ac0b5000 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.575+0000 7f79b0c07640 1 -- 172.21.15.63:0/4024762706 >> 172.21.15.63:0/4024762706 conn(0x7f79ac0d4580 msgr2=0x7f79ac06df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.576+0000 7f79b0c07640 1 -- 172.21.15.63:0/4024762706 shutdown_connections 2024-09-21T07:00:24.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.576+0000 7f79b0c07640 1 -- 172.21.15.63:0/4024762706 wait complete. 2024-09-21T07:00:24.590 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:00:24.590 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:00:24.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.707+0000 7f5f94ea4640 1 -- 172.21.15.63:0/1407335589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f7c004e60 msgr2=0x7f5f7c0052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.707+0000 7f5f94ea4640 1 --2- 172.21.15.63:0/1407335589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f7c004e60 0x7f5f7c0052d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f9008df70 tx=0x7f5f7c005830 comp rx=0 tx=0).stop 2024-09-21T07:00:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.707+0000 7f5f8ed9d640 1 -- 172.21.15.63:0/1407335589 reap_dead start 2024-09-21T07:00:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.708+0000 7f5f94ea4640 1 -- 172.21.15.63:0/1407335589 shutdown_connections 2024-09-21T07:00:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.708+0000 7f5f94ea4640 1 -- 172.21.15.63:0/1407335589 >> 172.21.15.63:0/1407335589 conn(0x7f5f9008bfd0 msgr2=0x7f5f900d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.708+0000 7f5f94ea4640 1 -- 172.21.15.63:0/1407335589 shutdown_connections 2024-09-21T07:00:24.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.708+0000 7f5f94ea4640 1 -- 172.21.15.63:0/1407335589 wait complete. 2024-09-21T07:00:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.709+0000 7f5f94ea4640 1 Processor -- start 2024-09-21T07:00:24.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.710+0000 7f5f94ea4640 1 -- start start 2024-09-21T07:00:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f94ea4640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f7c004e60 0x7f5f900ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f94ea4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f90158ba0 0x7f5f900b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f94ea4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900c8180 0x7f5f900c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f94ea4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5f90167af0 con 0x7f5f90158ba0 2024-09-21T07:00:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f94ea4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5f900d5560 con 0x7f5f900c8180 2024-09-21T07:00:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f94ea4640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5f90167c70 con 0x7f5f7c004e60 2024-09-21T07:00:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f8dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f90158ba0 0x7f5f900b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:24.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f8dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f90158ba0 0x7f5f900b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43276/0 (socket says 172.21.15.63:43276) 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f8dd9b640 1 -- 172.21.15.63:0/874619706 learned_addr learned my addr 172.21.15.63:0/874619706 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f8e59c640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f7c004e60 0x7f5f900ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f8ed9d640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900c8180 0x7f5f900c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f8dd9b640 1 -- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f7c004e60 msgr2=0x7f5f900ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f8dd9b640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f7c004e60 0x7f5f900ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f8dd9b640 1 -- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900c8180 msgr2=0x7f5f900c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f8dd9b640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900c8180 0x7f5f900c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f8dd9b640 1 -- 172.21.15.63:0/874619706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f900b4c00 con 0x7f5f90158ba0 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f8e59c640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f7c004e60 0x7f5f900ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.711+0000 7f5f8dd9b640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f90158ba0 0x7f5f900b46c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5f78003f80 tx=0x7f5f780016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.712+0000 7f5f86ffd640 1 -- 172.21.15.63:0/874619706 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78011700 con 0x7f5f90158ba0 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.712+0000 7f5f86ffd640 1 -- 172.21.15.63:0/874619706 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f78016020 con 0x7f5f90158ba0 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.712+0000 7f5f86ffd640 1 -- 172.21.15.63:0/874619706 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78011b20 con 0x7f5f90158ba0 2024-09-21T07:00:24.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.712+0000 7f5f94ea4640 1 -- 172.21.15.63:0/874619706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f900b5b00 con 0x7f5f90158ba0 2024-09-21T07:00:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.712+0000 7f5f94ea4640 1 -- 172.21.15.63:0/874619706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f900b3be0 con 0x7f5f90158ba0 2024-09-21T07:00:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.713+0000 7f5f94ea4640 1 -- 172.21.15.63:0/874619706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f900d2530 con 0x7f5f90158ba0 2024-09-21T07:00:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.713+0000 7f5f86ffd640 1 -- 172.21.15.63:0/874619706 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5f78011cc0 con 0x7f5f90158ba0 2024-09-21T07:00:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.714+0000 7f5f86ffd640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5f70078bc0 0x7f5f7007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:24.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.714+0000 7f5f86ffd640 1 -- 172.21.15.63:0/874619706 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5f7809b980 con 0x7f5f90158ba0 2024-09-21T07:00:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.714+0000 7f5f8e59c640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5f70078bc0 0x7f5f7007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:24.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.715+0000 7f5f8e59c640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5f70078bc0 0x7f5f7007b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5f80001500 tx=0x7f5f80006b40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:24.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.719+0000 7f5f86ffd640 1 -- 172.21.15.63:0/874619706 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5f78020020 con 0x7f5f90158ba0 2024-09-21T07:00:24.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.945+0000 7f5f94ea4640 1 -- 172.21.15.63:0/874619706 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f9006a130 con 0x7f5f90158ba0 2024-09-21T07:00:24.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.945+0000 7f5f86ffd640 1 -- 172.21.15.63:0/874619706 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5208 (secure 0 0 0) 0x7f5f78063dc0 con 0x7f5f90158ba0 2024-09-21T07:00:24.947 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:24.947 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-21T07:00:24:568573+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/4041704430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":4041704430},{"type":"v1","addr":"172.21.15.63:6834","nonce":4041704430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1032053510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":1032053510},{"type":"v1","addr":"172.21.15.63:6835","nonce":1032053510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/18747791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":18747791},{"type":"v1","addr":"172.21.15.71:6836","nonce":18747791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:00:20.923025+0000","modified":"2024-09-21T07:00:23.948505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/767391345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":767391345},{"type":"v1","addr":"172.21.15.71:6837","nonce":767391345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T07:00:24.948 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-21T07:00:24.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.947+0000 7f5f94ea4640 1 -- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5f70078bc0 msgr2=0x7f5f7007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:24.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.947+0000 7f5f94ea4640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5f70078bc0 0x7f5f7007b0d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5f80001500 tx=0x7f5f80006b40 comp rx=0 tx=0).stop 2024-09-21T07:00:24.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.947+0000 7f5f94ea4640 1 -- 172.21.15.63:0/874619706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f90158ba0 msgr2=0x7f5f900b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.947+0000 7f5f94ea4640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f90158ba0 0x7f5f900b46c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5f78003f80 tx=0x7f5f780016f0 comp rx=0 tx=0).stop 2024-09-21T07:00:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.947+0000 7f5f94ea4640 1 -- 172.21.15.63:0/874619706 shutdown_connections 2024-09-21T07:00:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.947+0000 7f5f94ea4640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5f70078bc0 0x7f5f7007b0d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.947+0000 7f5f94ea4640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5f900c8180 0x7f5f900c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.947+0000 7f5f94ea4640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5f90158ba0 0x7f5f900b46c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.947+0000 7f5f94ea4640 1 --2- 172.21.15.63:0/874619706 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5f7c004e60 0x7f5f900ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.947+0000 7f5f94ea4640 1 -- 172.21.15.63:0/874619706 >> 172.21.15.63:0/874619706 conn(0x7f5f9008bfd0 msgr2=0x7f5f900d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.947+0000 7f5f94ea4640 1 -- 172.21.15.63:0/874619706 shutdown_connections 2024-09-21T07:00:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:24.948+0000 7f5f94ea4640 1 -- 172.21.15.63:0/874619706 wait complete. 2024-09-21T07:00:24.960 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:00:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.075+0000 7f6222027640 1 -- 172.21.15.63:0/580890811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c0b3750 msgr2=0x7f621c09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.075+0000 7f6222027640 1 --2- 172.21.15.63:0/580890811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c0b3750 0x7f621c09aa40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f620c005fd0 tx=0x7f620c02a620 comp rx=0 tx=0).stop 2024-09-21T07:00:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.075+0000 7f6222027640 1 -- 172.21.15.63:0/580890811 shutdown_connections 2024-09-21T07:00:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.075+0000 7f6222027640 1 --2- 172.21.15.63:0/580890811 >> v2:172.21.15.71:3300/0 conn(0x7f621c09af80 0x7f621c0cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.075+0000 7f6222027640 1 --2- 172.21.15.63:0/580890811 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c0b3750 0x7f621c09aa40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.075+0000 7f6222027640 1 -- 172.21.15.63:0/580890811 >> 172.21.15.63:0/580890811 conn(0x7f621c0b3fb0 msgr2=0x7f621c0b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.075+0000 7f6222027640 1 -- 172.21.15.63:0/580890811 shutdown_connections 2024-09-21T07:00:25.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.075+0000 7f6222027640 1 -- 172.21.15.63:0/580890811 wait complete. 2024-09-21T07:00:25.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.077+0000 7f6222027640 1 Processor -- start 2024-09-21T07:00:25.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.077+0000 7f6222027640 1 -- start start 2024-09-21T07:00:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.078+0000 7f6222027640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f621c09af80 0x7f621c1f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.078+0000 7f6222027640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f621c0b3750 0x7f621c157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.078+0000 7f6222027640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c0b3b60 0x7f621c0c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.078+0000 7f6222027640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f621c0b6ac0 con 0x7f621c0b3b60 2024-09-21T07:00:25.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.078+0000 7f6222027640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f621c0b6940 con 0x7f621c0b3750 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.078+0000 7f6222027640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f621c0b6c40 con 0x7f621c09af80 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.078+0000 7f621bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c0b3b60 0x7f621c0c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.078+0000 7f621bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c0b3b60 0x7f621c0c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43290/0 (socket says 172.21.15.63:43290) 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.078+0000 7f621bfff640 1 -- 172.21.15.63:0/3447444096 learned_addr learned my addr 172.21.15.63:0/3447444096 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.078+0000 7f621b7fe640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f621c09af80 0x7f621c1f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.078+0000 7f621affd640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f621c0b3750 0x7f621c157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.079+0000 7f621bfff640 1 -- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f621c09af80 msgr2=0x7f621c1f78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.079+0000 7f621bfff640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f621c09af80 0x7f621c1f78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.079+0000 7f621bfff640 1 -- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f621c0b3750 msgr2=0x7f621c157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.079+0000 7f621bfff640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f621c0b3750 0x7f621c157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.079+0000 7f621bfff640 1 -- 172.21.15.63:0/3447444096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621c0b2ee0 con 0x7f621c0b3b60 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.079+0000 7f621bfff640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c0b3b60 0x7f621c0c9bc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f621400caa0 tx=0x7f621400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.079+0000 7f6203fff640 1 -- 172.21.15.63:0/3447444096 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621400adf0 con 0x7f621c0b3b60 2024-09-21T07:00:25.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.079+0000 7f6203fff640 1 -- 172.21.15.63:0/3447444096 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f621400f540 con 0x7f621c0b3b60 2024-09-21T07:00:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.079+0000 7f6222027640 1 -- 172.21.15.63:0/3447444096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621c0cc260 con 0x7f621c0b3b60 2024-09-21T07:00:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.079+0000 7f6203fff640 1 -- 172.21.15.63:0/3447444096 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621400f990 con 0x7f621c0b3b60 2024-09-21T07:00:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.079+0000 7f6222027640 1 -- 172.21.15.63:0/3447444096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621c0cbf80 con 0x7f621c0b3b60 2024-09-21T07:00:25.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.080+0000 7f6222027640 1 -- 172.21.15.63:0/3447444096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f621c0b71a0 con 0x7f621c0b3b60 2024-09-21T07:00:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.081+0000 7f6203fff640 1 -- 172.21.15.63:0/3447444096 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f621400fb30 con 0x7f621c0b3b60 2024-09-21T07:00:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.081+0000 7f6203fff640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6208078b90 0x7f620807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.081+0000 7f6203fff640 1 -- 172.21.15.63:0/3447444096 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f621409b710 con 0x7f621c0b3b60 2024-09-21T07:00:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.081+0000 7f621b7fe640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6208078b90 0x7f620807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:25.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.082+0000 7f621b7fe640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6208078b90 0x7f620807b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f620c033000 tx=0x7f620c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:25.087 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.086+0000 7f6203fff640 1 -- 172.21.15.63:0/3447444096 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f621c0b2ee0 con 0x7f621c0b3b60 2024-09-21T07:00:25.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.275+0000 7f6222027640 1 -- 172.21.15.63:0/3447444096 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f621c09bb50 con 0x7f621c0b3b60 2024-09-21T07:00:25.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.276+0000 7f6203fff640 1 -- 172.21.15.63:0/3447444096 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7f621400fe20 con 0x7f621c0b3b60 2024-09-21T07:00:25.278 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:25.278 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:00:22.544759+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:00:18.869431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:00:19.879189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:00:25.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.278+0000 7f6222027640 1 -- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6208078b90 msgr2=0x7f620807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.278+0000 7f6222027640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6208078b90 0x7f620807b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f620c033000 tx=0x7f620c004730 comp rx=0 tx=0).stop 2024-09-21T07:00:25.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.278+0000 7f6222027640 1 -- 172.21.15.63:0/3447444096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c0b3b60 msgr2=0x7f621c0c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.278+0000 7f6222027640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c0b3b60 0x7f621c0c9bc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f621400caa0 tx=0x7f621400cf60 comp rx=0 tx=0).stop 2024-09-21T07:00:25.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.278+0000 7f6222027640 1 -- 172.21.15.63:0/3447444096 shutdown_connections 2024-09-21T07:00:25.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.278+0000 7f6222027640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6208078b90 0x7f620807b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.278+0000 7f6222027640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f621c0b3b60 0x7f621c0c9bc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.278+0000 7f6222027640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f621c0b3750 0x7f621c157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.278+0000 7f6222027640 1 --2- 172.21.15.63:0/3447444096 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f621c09af80 0x7f621c1f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.278+0000 7f6222027640 1 -- 172.21.15.63:0/3447444096 >> 172.21.15.63:0/3447444096 conn(0x7f621c0b3fb0 msgr2=0x7f621c0b7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:25.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.278+0000 7f6222027640 1 -- 172.21.15.63:0/3447444096 shutdown_connections 2024-09-21T07:00:25.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.278+0000 7f6222027640 1 -- 172.21.15.63:0/3447444096 wait complete. 2024-09-21T07:00:25.292 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:00:25.292 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:00:25.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.406+0000 7f4d63750640 1 -- 172.21.15.63:0/3893031264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d48004800 msgr2=0x7f4d48004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.406+0000 7f4d63750640 1 --2- 172.21.15.63:0/3893031264 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d48004800 0x7f4d48004c10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0016c0 tx=0x7f4d48005830 comp rx=0 tx=0).stop 2024-09-21T07:00:25.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.406+0000 7f4d61ced640 1 -- 172.21.15.63:0/3893031264 reap_dead start 2024-09-21T07:00:25.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.406+0000 7f4d63750640 1 -- 172.21.15.63:0/3893031264 shutdown_connections 2024-09-21T07:00:25.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.406+0000 7f4d63750640 1 -- 172.21.15.63:0/3893031264 >> 172.21.15.63:0/3893031264 conn(0x7f4d5c08bfd0 msgr2=0x7f4d5c0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:25.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.407+0000 7f4d63750640 1 -- 172.21.15.63:0/3893031264 shutdown_connections 2024-09-21T07:00:25.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.407+0000 7f4d63750640 1 -- 172.21.15.63:0/3893031264 wait complete. 2024-09-21T07:00:25.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.408+0000 7f4d63750640 1 Processor -- start 2024-09-21T07:00:25.410 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.408+0000 7f4d63750640 1 -- start start 2024-09-21T07:00:25.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d63750640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d48004800 0x7f4d5c15f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d63750640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d5c162010 0x7f4d5c1499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d63750640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4d5c1f6510 0x7f4d5c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d63750640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c167af0 con 0x7f4d48004800 2024-09-21T07:00:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d63750640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c0d55b0 con 0x7f4d5c162010 2024-09-21T07:00:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d63750640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4d5c167c70 con 0x7f4d5c1f6510 2024-09-21T07:00:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d614ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d48004800 0x7f4d5c15f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d614ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d48004800 0x7f4d5c15f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43302/0 (socket says 172.21.15.63:43302) 2024-09-21T07:00:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d614ec640 1 -- 172.21.15.63:0/3184275000 learned_addr learned my addr 172.21.15.63:0/3184275000 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d61ced640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4d5c1f6510 0x7f4d5c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d60ceb640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d5c162010 0x7f4d5c1499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d614ec640 1 -- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4d5c1f6510 msgr2=0x7f4d5c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.413 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d614ec640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4d5c1f6510 0x7f4d5c15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d614ec640 1 -- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d5c162010 msgr2=0x7f4d5c1499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d614ec640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d5c162010 0x7f4d5c1499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d614ec640 1 -- 172.21.15.63:0/3184275000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5c15fcb0 con 0x7f4d48004800 2024-09-21T07:00:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d60ceb640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d5c162010 0x7f4d5c1499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d614ec640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d48004800 0x7f4d5c15f3b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4d58006fd0 tx=0x7f4d580039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d51ffb640 1 -- 172.21.15.63:0/3184275000 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58015070 con 0x7f4d48004800 2024-09-21T07:00:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d51ffb640 1 -- 172.21.15.63:0/3184275000 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d58011860 con 0x7f4d48004800 2024-09-21T07:00:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d63750640 1 -- 172.21.15.63:0/3184275000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d5c1f5a30 con 0x7f4d48004800 2024-09-21T07:00:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.410+0000 7f4d51ffb640 1 -- 172.21.15.63:0/3184275000 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58011cf0 con 0x7f4d48004800 2024-09-21T07:00:25.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.411+0000 7f4d63750640 1 -- 172.21.15.63:0/3184275000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d5c15ff90 con 0x7f4d48004800 2024-09-21T07:00:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.411+0000 7f4d63750640 1 -- 172.21.15.63:0/3184275000 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d5c06a130 con 0x7f4d48004800 2024-09-21T07:00:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.412+0000 7f4d51ffb640 1 -- 172.21.15.63:0/3184275000 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d58018070 con 0x7f4d48004800 2024-09-21T07:00:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.413+0000 7f4d51ffb640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4d40078b90 0x7f4d4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.413+0000 7f4d51ffb640 1 -- 172.21.15.63:0/3184275000 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4d5809b980 con 0x7f4d48004800 2024-09-21T07:00:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.413+0000 7f4d60ceb640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4d40078b90 0x7f4d4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:25.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.414+0000 7f4d60ceb640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4d40078b90 0x7f4d4007b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c032000 tx=0x7f4d4c001190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:25.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.418+0000 7f4d51ffb640 1 -- 172.21.15.63:0/3184275000 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4d58063810 con 0x7f4d48004800 2024-09-21T07:00:25.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.602+0000 7f4d63750640 1 -- 172.21.15.63:0/3184275000 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d5c0d1120 con 0x7f4d40078b90 2024-09-21T07:00:25.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.607+0000 7f4d51ffb640 1 -- 172.21.15.63:0/3184275000 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241525 (secure 0 0 0) 0x7f4d5c0d1120 con 0x7f4d40078b90 2024-09-21T07:00:25.611 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:25.612 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:00:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.610+0000 7f4d63750640 1 -- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4d40078b90 msgr2=0x7f4d4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.610+0000 7f4d63750640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4d40078b90 0x7f4d4007b0a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c032000 tx=0x7f4d4c001190 comp rx=0 tx=0).stop 2024-09-21T07:00:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.610+0000 7f4d63750640 1 -- 172.21.15.63:0/3184275000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d48004800 msgr2=0x7f4d5c15f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.610+0000 7f4d63750640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d48004800 0x7f4d5c15f3b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4d58006fd0 tx=0x7f4d580039c0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.610+0000 7f4d63750640 1 -- 172.21.15.63:0/3184275000 shutdown_connections 2024-09-21T07:00:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.610+0000 7f4d63750640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4d40078b90 0x7f4d4007b0a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.610+0000 7f4d63750640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4d5c1f6510 0x7f4d5c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.610+0000 7f4d63750640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4d5c162010 0x7f4d5c1499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.610+0000 7f4d63750640 1 --2- 172.21.15.63:0/3184275000 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4d48004800 0x7f4d5c15f3b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.611+0000 7f4d63750640 1 -- 172.21.15.63:0/3184275000 >> 172.21.15.63:0/3184275000 conn(0x7f4d5c08bfd0 msgr2=0x7f4d5c06e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:25.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.611+0000 7f4d63750640 1 -- 172.21.15.63:0/3184275000 shutdown_connections 2024-09-21T07:00:25.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.611+0000 7f4d63750640 1 -- 172.21.15.63:0/3184275000 wait complete. 2024-09-21T07:00:25.623 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-21T07:00:24.597650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":120,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":80,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2608,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2670592,"data_stored":1636331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.070868"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.560284+0000","last_change":"2024-09-21T07:00:21.558126+0000","last_active":"2024-09-21T07:00:21.560284+0000","last_peered":"2024-09-21T07:00:21.560284+0000","last_clean":"2024-09-21T07:00:21.560284+0000","last_became_active":"2024-09-21T07:00:21.557784+0000","last_became_peered":"2024-09-21T07:00:21.557784+0000","last_unstale":"2024-09-21T07:00:21.560284+0000","last_undegraded":"2024-09-21T07:00:21.560284+0000","last_fullsized":"2024-09-21T07:00:21.560284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:24.273272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.530751+0000","last_change":"2024-09-21T07:00:19.530751+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.530751+0000","last_undegraded":"2024-09-21T07:00:19.530751+0000","last_fullsized":"2024-09-21T07:00:19.530751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.566798+0000","last_change":"2024-09-21T07:00:21.565217+0000","last_active":"2024-09-21T07:00:21.566798+0000","last_peered":"2024-09-21T07:00:21.566798+0000","last_clean":"2024-09-21T07:00:21.566798+0000","last_became_active":"2024-09-21T07:00:21.564900+0000","last_became_peered":"2024-09-21T07:00:21.564900+0000","last_unstale":"2024-09-21T07:00:21.566798+0000","last_undegraded":"2024-09-21T07:00:21.566798+0000","last_fullsized":"2024-09-21T07:00:21.566798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:58.663235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.536833+0000","last_change":"2024-09-21T07:00:19.536833+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.536833+0000","last_undegraded":"2024-09-21T07:00:19.536833+0000","last_fullsized":"2024-09-21T07:00:19.536833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.529569+0000","last_change":"2024-09-21T07:00:19.529569+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.529569+0000","last_undegraded":"2024-09-21T07:00:19.529569+0000","last_fullsized":"2024-09-21T07:00:19.529569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535766+0000","last_change":"2024-09-21T07:00:19.535766+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535766+0000","last_undegraded":"2024-09-21T07:00:19.535766+0000","last_fullsized":"2024-09-21T07:00:19.535766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.566659+0000","last_change":"2024-09-21T07:00:21.563091+0000","last_active":"2024-09-21T07:00:21.566659+0000","last_peered":"2024-09-21T07:00:21.566659+0000","last_clean":"2024-09-21T07:00:21.566659+0000","last_became_active":"2024-09-21T07:00:21.562811+0000","last_became_peered":"2024-09-21T07:00:21.562811+0000","last_unstale":"2024-09-21T07:00:21.566659+0000","last_undegraded":"2024-09-21T07:00:21.566659+0000","last_fullsized":"2024-09-21T07:00:21.566659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:43.401058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.533178+0000","last_change":"2024-09-21T07:00:19.533178+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.533178+0000","last_undegraded":"2024-09-21T07:00:19.533178+0000","last_fullsized":"2024-09-21T07:00:19.533178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528280+0000","last_change":"2024-09-21T07:00:19.528280+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528280+0000","last_undegraded":"2024-09-21T07:00:19.528280+0000","last_fullsized":"2024-09-21T07:00:19.528280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535278+0000","last_change":"2024-09-21T07:00:19.535278+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535278+0000","last_undegraded":"2024-09-21T07:00:19.535278+0000","last_fullsized":"2024-09-21T07:00:19.535278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.533242+0000","last_change":"2024-09-21T07:00:19.533242+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.533242+0000","last_undegraded":"2024-09-21T07:00:19.533242+0000","last_fullsized":"2024-09-21T07:00:19.533242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535195+0000","last_change":"2024-09-21T07:00:19.535195+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535195+0000","last_undegraded":"2024-09-21T07:00:19.535195+0000","last_fullsized":"2024-09-21T07:00:19.535195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.536250+0000","last_change":"2024-09-21T07:00:19.536250+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.536250+0000","last_undegraded":"2024-09-21T07:00:19.536250+0000","last_fullsized":"2024-09-21T07:00:19.536250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528627+0000","last_change":"2024-09-21T07:00:19.528627+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528627+0000","last_undegraded":"2024-09-21T07:00:19.528627+0000","last_fullsized":"2024-09-21T07:00:19.528627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.565999+0000","last_change":"2024-09-21T07:00:20.549484+0000","last_active":"2024-09-21T07:00:21.565999+0000","last_peered":"2024-09-21T07:00:21.565999+0000","last_clean":"2024-09-21T07:00:21.565999+0000","last_became_active":"2024-09-21T07:00:20.549138+0000","last_became_peered":"2024-09-21T07:00:20.549138+0000","last_unstale":"2024-09-21T07:00:21.565999+0000","last_undegraded":"2024-09-21T07:00:21.565999+0000","last_fullsized":"2024-09-21T07:00:21.565999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:49.823889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528290+0000","last_change":"2024-09-21T07:00:19.528290+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528290+0000","last_undegraded":"2024-09-21T07:00:19.528290+0000","last_fullsized":"2024-09-21T07:00:19.528290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.567632+0000","last_change":"2024-09-21T07:00:20.546640+0000","last_active":"2024-09-21T07:00:21.567632+0000","last_peered":"2024-09-21T07:00:21.567632+0000","last_clean":"2024-09-21T07:00:21.567632+0000","last_became_active":"2024-09-21T07:00:20.545583+0000","last_became_peered":"2024-09-21T07:00:20.545583+0000","last_unstale":"2024-09-21T07:00:21.567632+0000","last_undegraded":"2024-09-21T07:00:21.567632+0000","last_fullsized":"2024-09-21T07:00:21.567632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:24.006199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.532284+0000","last_change":"2024-09-21T07:00:19.532284+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.532284+0000","last_undegraded":"2024-09-21T07:00:19.532284+0000","last_fullsized":"2024-09-21T07:00:19.532284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.529881+0000","last_change":"2024-09-21T07:00:19.529881+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.529881+0000","last_undegraded":"2024-09-21T07:00:19.529881+0000","last_fullsized":"2024-09-21T07:00:19.529881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":105,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-21T07:00:19.534987+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:00:19.534987+0000","last_peered":"2024-09-21T07:00:19.534987+0000","last_clean":"2024-09-21T07:00:19.534987+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:00:19.534987+0000","last_undegraded":"2024-09-21T07:00:19.534987+0000","last_fullsized":"2024-09-21T07:00:19.534987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.533641+0000","last_change":"2024-09-21T07:00:19.533641+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.533641+0000","last_undegraded":"2024-09-21T07:00:19.533641+0000","last_fullsized":"2024-09-21T07:00:19.533641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.560140+0000","last_change":"2024-09-21T07:00:21.555846+0000","last_active":"2024-09-21T07:00:21.560140+0000","last_peered":"2024-09-21T07:00:21.560140+0000","last_clean":"2024-09-21T07:00:21.560140+0000","last_became_active":"2024-09-21T07:00:21.555489+0000","last_became_peered":"2024-09-21T07:00:21.555489+0000","last_unstale":"2024-09-21T07:00:21.560140+0000","last_undegraded":"2024-09-21T07:00:21.560140+0000","last_fullsized":"2024-09-21T07:00:21.560140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:20.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.534788+0000","last_change":"2024-09-21T07:00:19.534788+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.534788+0000","last_undegraded":"2024-09-21T07:00:19.534788+0000","last_fullsized":"2024-09-21T07:00:19.534788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535191+0000","last_change":"2024-09-21T07:00:19.535191+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535191+0000","last_undegraded":"2024-09-21T07:00:19.535191+0000","last_fullsized":"2024-09-21T07:00:19.535191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.534296+0000","last_change":"2024-09-21T07:00:19.534296+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.534296+0000","last_undegraded":"2024-09-21T07:00:19.534296+0000","last_fullsized":"2024-09-21T07:00:19.534296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.531445+0000","last_change":"2024-09-21T07:00:19.531445+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.531445+0000","last_undegraded":"2024-09-21T07:00:19.531445+0000","last_fullsized":"2024-09-21T07:00:19.531445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.534768+0000","last_change":"2024-09-21T07:00:19.534768+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.534768+0000","last_undegraded":"2024-09-21T07:00:19.534768+0000","last_fullsized":"2024-09-21T07:00:19.534768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.542399+0000","last_change":"2024-09-21T07:00:20.555344+0000","last_active":"2024-09-21T07:00:21.542399+0000","last_peered":"2024-09-21T07:00:21.542399+0000","last_clean":"2024-09-21T07:00:21.542399+0000","last_became_active":"2024-09-21T07:00:20.555062+0000","last_became_peered":"2024-09-21T07:00:20.555062+0000","last_unstale":"2024-09-21T07:00:21.542399+0000","last_undegraded":"2024-09-21T07:00:21.542399+0000","last_fullsized":"2024-09-21T07:00:21.542399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:48.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.559978+0000","last_change":"2024-09-21T07:00:21.555637+0000","last_active":"2024-09-21T07:00:21.559978+0000","last_peered":"2024-09-21T07:00:21.559978+0000","last_clean":"2024-09-21T07:00:21.559978+0000","last_became_active":"2024-09-21T07:00:21.554035+0000","last_became_peered":"2024-09-21T07:00:21.554035+0000","last_unstale":"2024-09-21T07:00:21.559978+0000","last_undegraded":"2024-09-21T07:00:21.559978+0000","last_fullsized":"2024-09-21T07:00:21.559978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:31.094122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535328+0000","last_change":"2024-09-21T07:00:19.535328+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535328+0000","last_undegraded":"2024-09-21T07:00:19.535328+0000","last_fullsized":"2024-09-21T07:00:19.535328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.562149+0000","last_change":"2024-09-21T07:00:21.559146+0000","last_active":"2024-09-21T07:00:21.562149+0000","last_peered":"2024-09-21T07:00:21.562149+0000","last_clean":"2024-09-21T07:00:21.562149+0000","last_became_active":"2024-09-21T07:00:21.558843+0000","last_became_peered":"2024-09-21T07:00:21.558843+0000","last_unstale":"2024-09-21T07:00:21.562149+0000","last_undegraded":"2024-09-21T07:00:21.562149+0000","last_fullsized":"2024-09-21T07:00:21.562149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:35.286384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528283+0000","last_change":"2024-09-21T07:00:19.528283+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528283+0000","last_undegraded":"2024-09-21T07:00:19.528283+0000","last_fullsized":"2024-09-21T07:00:19.528283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.541794+0000","last_change":"2024-09-21T07:00:20.554018+0000","last_active":"2024-09-21T07:00:21.541794+0000","last_peered":"2024-09-21T07:00:21.541794+0000","last_clean":"2024-09-21T07:00:21.541794+0000","last_became_active":"2024-09-21T07:00:20.553671+0000","last_became_peered":"2024-09-21T07:00:20.553671+0000","last_unstale":"2024-09-21T07:00:21.541794+0000","last_undegraded":"2024-09-21T07:00:21.541794+0000","last_fullsized":"2024-09-21T07:00:21.541794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:05.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.560341+0000","last_change":"2024-09-21T07:00:21.557634+0000","last_active":"2024-09-21T07:00:21.560341+0000","last_peered":"2024-09-21T07:00:21.560341+0000","last_clean":"2024-09-21T07:00:21.560341+0000","last_became_active":"2024-09-21T07:00:21.557321+0000","last_became_peered":"2024-09-21T07:00:21.557321+0000","last_unstale":"2024-09-21T07:00:21.560341+0000","last_undegraded":"2024-09-21T07:00:21.560341+0000","last_fullsized":"2024-09-21T07:00:21.560341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:54.847595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.530357+0000","last_change":"2024-09-21T07:00:19.530357+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.530357+0000","last_undegraded":"2024-09-21T07:00:19.530357+0000","last_fullsized":"2024-09-21T07:00:19.530357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.534453+0000","last_change":"2024-09-21T07:00:19.534453+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.534453+0000","last_undegraded":"2024-09-21T07:00:19.534453+0000","last_fullsized":"2024-09-21T07:00:19.534453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528508+0000","last_change":"2024-09-21T07:00:19.528508+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528508+0000","last_undegraded":"2024-09-21T07:00:19.528508+0000","last_fullsized":"2024-09-21T07:00:19.528508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528783+0000","last_change":"2024-09-21T07:00:19.528783+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528783+0000","last_undegraded":"2024-09-21T07:00:19.528783+0000","last_fullsized":"2024-09-21T07:00:19.528783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.532167+0000","last_change":"2024-09-21T07:00:19.532167+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.532167+0000","last_undegraded":"2024-09-21T07:00:19.532167+0000","last_fullsized":"2024-09-21T07:00:19.532167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.568036+0000","last_change":"2024-09-21T07:00:20.544364+0000","last_active":"2024-09-21T07:00:21.568036+0000","last_peered":"2024-09-21T07:00:21.568036+0000","last_clean":"2024-09-21T07:00:21.568036+0000","last_became_active":"2024-09-21T07:00:20.543152+0000","last_became_peered":"2024-09-21T07:00:20.543152+0000","last_unstale":"2024-09-21T07:00:21.568036+0000","last_undegraded":"2024-09-21T07:00:21.568036+0000","last_fullsized":"2024-09-21T07:00:21.568036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:24.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":765952,"data_stored":641765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":51397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":647582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":51397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":72548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:00:25.627 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:00:25.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.778+0000 7f040b04d640 1 -- 172.21.15.63:0/4160596136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f4004e60 msgr2=0x7f03f40052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.778+0000 7f040b04d640 1 --2- 172.21.15.63:0/4160596136 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f4004e60 0x7f03f40052d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04040b28b0 tx=0x7f03f4005830 comp rx=0 tx=0).stop 2024-09-21T07:00:25.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.778+0000 7f04095ea640 1 -- 172.21.15.63:0/4160596136 reap_dead start 2024-09-21T07:00:25.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.778+0000 7f040b04d640 1 -- 172.21.15.63:0/4160596136 shutdown_connections 2024-09-21T07:00:25.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.778+0000 7f040b04d640 1 -- 172.21.15.63:0/4160596136 >> 172.21.15.63:0/4160596136 conn(0x7f04040b3050 msgr2=0x7f04040b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:25.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.778+0000 7f040b04d640 1 -- 172.21.15.63:0/4160596136 shutdown_connections 2024-09-21T07:00:25.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.778+0000 7f040b04d640 1 -- 172.21.15.63:0/4160596136 wait complete. 2024-09-21T07:00:25.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.780+0000 7f040b04d640 1 Processor -- start 2024-09-21T07:00:25.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.780+0000 7f040b04d640 1 -- start start 2024-09-21T07:00:25.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.781+0000 7f040b04d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f4004e60 0x7f04041f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:25.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.781+0000 7f040b04d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04040b6570 0x7f04041611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.781+0000 7f040b04d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0404161710 0x7f04041f8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.781+0000 7f040b04d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f04040b1530 con 0x7f03f4004e60 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.781+0000 7f040b04d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f04040b13b0 con 0x7f04040b6570 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.781+0000 7f040b04d640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f04040b16b0 con 0x7f0404161710 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f0408de9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f4004e60 0x7f04041f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f0408de9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f4004e60 0x7f04041f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43322/0 (socket says 172.21.15.63:43322) 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f0408de9640 1 -- 172.21.15.63:0/616791182 learned_addr learned my addr 172.21.15.63:0/616791182 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f04095ea640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0404161710 0x7f04041f8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f0403fff640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04040b6570 0x7f04041611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f0408de9640 1 -- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0404161710 msgr2=0x7f04041f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f0408de9640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0404161710 0x7f04041f8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f0408de9640 1 -- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04040b6570 msgr2=0x7f04041611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f0408de9640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04040b6570 0x7f04041611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f0408de9640 1 -- 172.21.15.63:0/616791182 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0404161b20 con 0x7f03f4004e60 2024-09-21T07:00:25.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f0408de9640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f4004e60 0x7f04041f60c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f03f8006680 tx=0x7f03f80066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:25.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f04017fa640 1 -- 172.21.15.63:0/616791182 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8011700 con 0x7f03f4004e60 2024-09-21T07:00:25.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f04017fa640 1 -- 172.21.15.63:0/616791182 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03f8016020 con 0x7f03f4004e60 2024-09-21T07:00:25.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f040b04d640 1 -- 172.21.15.63:0/616791182 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04040cc2b0 con 0x7f03f4004e60 2024-09-21T07:00:25.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f04017fa640 1 -- 172.21.15.63:0/616791182 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8011b60 con 0x7f03f4004e60 2024-09-21T07:00:25.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.782+0000 7f040b04d640 1 -- 172.21.15.63:0/616791182 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04040cc870 con 0x7f03f4004e60 2024-09-21T07:00:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.784+0000 7f040b04d640 1 -- 172.21.15.63:0/616791182 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040415b880 con 0x7f03f4004e60 2024-09-21T07:00:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.784+0000 7f04017fa640 1 -- 172.21.15.63:0/616791182 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f03f8011d00 con 0x7f03f4004e60 2024-09-21T07:00:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.784+0000 7f04017fa640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f03e8078b90 0x7f03e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.785+0000 7f04017fa640 1 -- 172.21.15.63:0/616791182 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f03f809b870 con 0x7f03f4004e60 2024-09-21T07:00:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.785+0000 7f0403fff640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f03e8078b90 0x7f03e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:25.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.785+0000 7f0403fff640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f03e8078b90 0x7f03e807b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0404150670 tx=0x7f03f0005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:25.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.789+0000 7f04017fa640 1 -- 172.21.15.63:0/616791182 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f040415b880 con 0x7f03f4004e60 2024-09-21T07:00:25.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.971+0000 7f040b04d640 1 -- 172.21.15.63:0/616791182 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04040b1bb0 con 0x7f03e8078b90 2024-09-21T07:00:25.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.976+0000 7f04017fa640 1 -- 172.21.15.63:0/616791182 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241525 (secure 0 0 0) 0x7f04040b1bb0 con 0x7f03e8078b90 2024-09-21T07:00:25.980 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:25.981 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:00:25.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.979+0000 7f040b04d640 1 -- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f03e8078b90 msgr2=0x7f03e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.979+0000 7f040b04d640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f03e8078b90 0x7f03e807b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0404150670 tx=0x7f03f0005f90 comp rx=0 tx=0).stop 2024-09-21T07:00:25.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.979+0000 7f040b04d640 1 -- 172.21.15.63:0/616791182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f4004e60 msgr2=0x7f04041f60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:25.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.979+0000 7f040b04d640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f4004e60 0x7f04041f60c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f03f8006680 tx=0x7f03f80066b0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.979+0000 7f040b04d640 1 -- 172.21.15.63:0/616791182 shutdown_connections 2024-09-21T07:00:25.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.979+0000 7f040b04d640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f03e8078b90 0x7f03e807b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.979+0000 7f040b04d640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0404161710 0x7f04041f8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.979+0000 7f040b04d640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04040b6570 0x7f04041611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.979+0000 7f040b04d640 1 --2- 172.21.15.63:0/616791182 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03f4004e60 0x7f04041f60c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:25.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.979+0000 7f040b04d640 1 -- 172.21.15.63:0/616791182 >> 172.21.15.63:0/616791182 conn(0x7f04040b3050 msgr2=0x7f040415a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:25.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.979+0000 7f040b04d640 1 -- 172.21.15.63:0/616791182 shutdown_connections 2024-09-21T07:00:25.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:25.979+0000 7f040b04d640 1 -- 172.21.15.63:0/616791182 wait complete. 2024-09-21T07:00:25.992 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-21T07:00:24.597650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":120,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":80,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2608,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2670592,"data_stored":1636331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.070868"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.560284+0000","last_change":"2024-09-21T07:00:21.558126+0000","last_active":"2024-09-21T07:00:21.560284+0000","last_peered":"2024-09-21T07:00:21.560284+0000","last_clean":"2024-09-21T07:00:21.560284+0000","last_became_active":"2024-09-21T07:00:21.557784+0000","last_became_peered":"2024-09-21T07:00:21.557784+0000","last_unstale":"2024-09-21T07:00:21.560284+0000","last_undegraded":"2024-09-21T07:00:21.560284+0000","last_fullsized":"2024-09-21T07:00:21.560284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:24.273272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.530751+0000","last_change":"2024-09-21T07:00:19.530751+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.530751+0000","last_undegraded":"2024-09-21T07:00:19.530751+0000","last_fullsized":"2024-09-21T07:00:19.530751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.566798+0000","last_change":"2024-09-21T07:00:21.565217+0000","last_active":"2024-09-21T07:00:21.566798+0000","last_peered":"2024-09-21T07:00:21.566798+0000","last_clean":"2024-09-21T07:00:21.566798+0000","last_became_active":"2024-09-21T07:00:21.564900+0000","last_became_peered":"2024-09-21T07:00:21.564900+0000","last_unstale":"2024-09-21T07:00:21.566798+0000","last_undegraded":"2024-09-21T07:00:21.566798+0000","last_fullsized":"2024-09-21T07:00:21.566798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:58.663235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.536833+0000","last_change":"2024-09-21T07:00:19.536833+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.536833+0000","last_undegraded":"2024-09-21T07:00:19.536833+0000","last_fullsized":"2024-09-21T07:00:19.536833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.529569+0000","last_change":"2024-09-21T07:00:19.529569+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.529569+0000","last_undegraded":"2024-09-21T07:00:19.529569+0000","last_fullsized":"2024-09-21T07:00:19.529569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535766+0000","last_change":"2024-09-21T07:00:19.535766+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535766+0000","last_undegraded":"2024-09-21T07:00:19.535766+0000","last_fullsized":"2024-09-21T07:00:19.535766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.566659+0000","last_change":"2024-09-21T07:00:21.563091+0000","last_active":"2024-09-21T07:00:21.566659+0000","last_peered":"2024-09-21T07:00:21.566659+0000","last_clean":"2024-09-21T07:00:21.566659+0000","last_became_active":"2024-09-21T07:00:21.562811+0000","last_became_peered":"2024-09-21T07:00:21.562811+0000","last_unstale":"2024-09-21T07:00:21.566659+0000","last_undegraded":"2024-09-21T07:00:21.566659+0000","last_fullsized":"2024-09-21T07:00:21.566659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:43.401058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.533178+0000","last_change":"2024-09-21T07:00:19.533178+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.533178+0000","last_undegraded":"2024-09-21T07:00:19.533178+0000","last_fullsized":"2024-09-21T07:00:19.533178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528280+0000","last_change":"2024-09-21T07:00:19.528280+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528280+0000","last_undegraded":"2024-09-21T07:00:19.528280+0000","last_fullsized":"2024-09-21T07:00:19.528280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535278+0000","last_change":"2024-09-21T07:00:19.535278+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535278+0000","last_undegraded":"2024-09-21T07:00:19.535278+0000","last_fullsized":"2024-09-21T07:00:19.535278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.533242+0000","last_change":"2024-09-21T07:00:19.533242+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.533242+0000","last_undegraded":"2024-09-21T07:00:19.533242+0000","last_fullsized":"2024-09-21T07:00:19.533242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535195+0000","last_change":"2024-09-21T07:00:19.535195+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535195+0000","last_undegraded":"2024-09-21T07:00:19.535195+0000","last_fullsized":"2024-09-21T07:00:19.535195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.536250+0000","last_change":"2024-09-21T07:00:19.536250+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.536250+0000","last_undegraded":"2024-09-21T07:00:19.536250+0000","last_fullsized":"2024-09-21T07:00:19.536250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528627+0000","last_change":"2024-09-21T07:00:19.528627+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528627+0000","last_undegraded":"2024-09-21T07:00:19.528627+0000","last_fullsized":"2024-09-21T07:00:19.528627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.565999+0000","last_change":"2024-09-21T07:00:20.549484+0000","last_active":"2024-09-21T07:00:21.565999+0000","last_peered":"2024-09-21T07:00:21.565999+0000","last_clean":"2024-09-21T07:00:21.565999+0000","last_became_active":"2024-09-21T07:00:20.549138+0000","last_became_peered":"2024-09-21T07:00:20.549138+0000","last_unstale":"2024-09-21T07:00:21.565999+0000","last_undegraded":"2024-09-21T07:00:21.565999+0000","last_fullsized":"2024-09-21T07:00:21.565999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:49.823889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528290+0000","last_change":"2024-09-21T07:00:19.528290+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528290+0000","last_undegraded":"2024-09-21T07:00:19.528290+0000","last_fullsized":"2024-09-21T07:00:19.528290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.567632+0000","last_change":"2024-09-21T07:00:20.546640+0000","last_active":"2024-09-21T07:00:21.567632+0000","last_peered":"2024-09-21T07:00:21.567632+0000","last_clean":"2024-09-21T07:00:21.567632+0000","last_became_active":"2024-09-21T07:00:20.545583+0000","last_became_peered":"2024-09-21T07:00:20.545583+0000","last_unstale":"2024-09-21T07:00:21.567632+0000","last_undegraded":"2024-09-21T07:00:21.567632+0000","last_fullsized":"2024-09-21T07:00:21.567632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:24.006199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.532284+0000","last_change":"2024-09-21T07:00:19.532284+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.532284+0000","last_undegraded":"2024-09-21T07:00:19.532284+0000","last_fullsized":"2024-09-21T07:00:19.532284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.529881+0000","last_change":"2024-09-21T07:00:19.529881+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.529881+0000","last_undegraded":"2024-09-21T07:00:19.529881+0000","last_fullsized":"2024-09-21T07:00:19.529881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":105,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-21T07:00:19.534987+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:00:19.534987+0000","last_peered":"2024-09-21T07:00:19.534987+0000","last_clean":"2024-09-21T07:00:19.534987+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:00:19.534987+0000","last_undegraded":"2024-09-21T07:00:19.534987+0000","last_fullsized":"2024-09-21T07:00:19.534987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.533641+0000","last_change":"2024-09-21T07:00:19.533641+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.533641+0000","last_undegraded":"2024-09-21T07:00:19.533641+0000","last_fullsized":"2024-09-21T07:00:19.533641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.560140+0000","last_change":"2024-09-21T07:00:21.555846+0000","last_active":"2024-09-21T07:00:21.560140+0000","last_peered":"2024-09-21T07:00:21.560140+0000","last_clean":"2024-09-21T07:00:21.560140+0000","last_became_active":"2024-09-21T07:00:21.555489+0000","last_became_peered":"2024-09-21T07:00:21.555489+0000","last_unstale":"2024-09-21T07:00:21.560140+0000","last_undegraded":"2024-09-21T07:00:21.560140+0000","last_fullsized":"2024-09-21T07:00:21.560140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:20.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.534788+0000","last_change":"2024-09-21T07:00:19.534788+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.534788+0000","last_undegraded":"2024-09-21T07:00:19.534788+0000","last_fullsized":"2024-09-21T07:00:19.534788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535191+0000","last_change":"2024-09-21T07:00:19.535191+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535191+0000","last_undegraded":"2024-09-21T07:00:19.535191+0000","last_fullsized":"2024-09-21T07:00:19.535191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.534296+0000","last_change":"2024-09-21T07:00:19.534296+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.534296+0000","last_undegraded":"2024-09-21T07:00:19.534296+0000","last_fullsized":"2024-09-21T07:00:19.534296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.531445+0000","last_change":"2024-09-21T07:00:19.531445+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.531445+0000","last_undegraded":"2024-09-21T07:00:19.531445+0000","last_fullsized":"2024-09-21T07:00:19.531445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.534768+0000","last_change":"2024-09-21T07:00:19.534768+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.534768+0000","last_undegraded":"2024-09-21T07:00:19.534768+0000","last_fullsized":"2024-09-21T07:00:19.534768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.542399+0000","last_change":"2024-09-21T07:00:20.555344+0000","last_active":"2024-09-21T07:00:21.542399+0000","last_peered":"2024-09-21T07:00:21.542399+0000","last_clean":"2024-09-21T07:00:21.542399+0000","last_became_active":"2024-09-21T07:00:20.555062+0000","last_became_peered":"2024-09-21T07:00:20.555062+0000","last_unstale":"2024-09-21T07:00:21.542399+0000","last_undegraded":"2024-09-21T07:00:21.542399+0000","last_fullsized":"2024-09-21T07:00:21.542399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:48.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.559978+0000","last_change":"2024-09-21T07:00:21.555637+0000","last_active":"2024-09-21T07:00:21.559978+0000","last_peered":"2024-09-21T07:00:21.559978+0000","last_clean":"2024-09-21T07:00:21.559978+0000","last_became_active":"2024-09-21T07:00:21.554035+0000","last_became_peered":"2024-09-21T07:00:21.554035+0000","last_unstale":"2024-09-21T07:00:21.559978+0000","last_undegraded":"2024-09-21T07:00:21.559978+0000","last_fullsized":"2024-09-21T07:00:21.559978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:31.094122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535328+0000","last_change":"2024-09-21T07:00:19.535328+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535328+0000","last_undegraded":"2024-09-21T07:00:19.535328+0000","last_fullsized":"2024-09-21T07:00:19.535328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.562149+0000","last_change":"2024-09-21T07:00:21.559146+0000","last_active":"2024-09-21T07:00:21.562149+0000","last_peered":"2024-09-21T07:00:21.562149+0000","last_clean":"2024-09-21T07:00:21.562149+0000","last_became_active":"2024-09-21T07:00:21.558843+0000","last_became_peered":"2024-09-21T07:00:21.558843+0000","last_unstale":"2024-09-21T07:00:21.562149+0000","last_undegraded":"2024-09-21T07:00:21.562149+0000","last_fullsized":"2024-09-21T07:00:21.562149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:35.286384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528283+0000","last_change":"2024-09-21T07:00:19.528283+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528283+0000","last_undegraded":"2024-09-21T07:00:19.528283+0000","last_fullsized":"2024-09-21T07:00:19.528283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.541794+0000","last_change":"2024-09-21T07:00:20.554018+0000","last_active":"2024-09-21T07:00:21.541794+0000","last_peered":"2024-09-21T07:00:21.541794+0000","last_clean":"2024-09-21T07:00:21.541794+0000","last_became_active":"2024-09-21T07:00:20.553671+0000","last_became_peered":"2024-09-21T07:00:20.553671+0000","last_unstale":"2024-09-21T07:00:21.541794+0000","last_undegraded":"2024-09-21T07:00:21.541794+0000","last_fullsized":"2024-09-21T07:00:21.541794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:05.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.560341+0000","last_change":"2024-09-21T07:00:21.557634+0000","last_active":"2024-09-21T07:00:21.560341+0000","last_peered":"2024-09-21T07:00:21.560341+0000","last_clean":"2024-09-21T07:00:21.560341+0000","last_became_active":"2024-09-21T07:00:21.557321+0000","last_became_peered":"2024-09-21T07:00:21.557321+0000","last_unstale":"2024-09-21T07:00:21.560341+0000","last_undegraded":"2024-09-21T07:00:21.560341+0000","last_fullsized":"2024-09-21T07:00:21.560341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:54.847595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.530357+0000","last_change":"2024-09-21T07:00:19.530357+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.530357+0000","last_undegraded":"2024-09-21T07:00:19.530357+0000","last_fullsized":"2024-09-21T07:00:19.530357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.534453+0000","last_change":"2024-09-21T07:00:19.534453+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.534453+0000","last_undegraded":"2024-09-21T07:00:19.534453+0000","last_fullsized":"2024-09-21T07:00:19.534453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528508+0000","last_change":"2024-09-21T07:00:19.528508+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528508+0000","last_undegraded":"2024-09-21T07:00:19.528508+0000","last_fullsized":"2024-09-21T07:00:19.528508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528783+0000","last_change":"2024-09-21T07:00:19.528783+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528783+0000","last_undegraded":"2024-09-21T07:00:19.528783+0000","last_fullsized":"2024-09-21T07:00:19.528783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.532167+0000","last_change":"2024-09-21T07:00:19.532167+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.532167+0000","last_undegraded":"2024-09-21T07:00:19.532167+0000","last_fullsized":"2024-09-21T07:00:19.532167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.568036+0000","last_change":"2024-09-21T07:00:20.544364+0000","last_active":"2024-09-21T07:00:21.568036+0000","last_peered":"2024-09-21T07:00:21.568036+0000","last_clean":"2024-09-21T07:00:21.568036+0000","last_became_active":"2024-09-21T07:00:20.543152+0000","last_became_peered":"2024-09-21T07:00:20.543152+0000","last_unstale":"2024-09-21T07:00:21.568036+0000","last_undegraded":"2024-09-21T07:00:21.568036+0000","last_fullsized":"2024-09-21T07:00:21.568036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:24.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":765952,"data_stored":641765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":51397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":647582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":51397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":72548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:00:25.995 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:00:26.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.145+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/992656910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c815ef00 msgr2=0x7fc2c80d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:26.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.145+0000 7fc2ccf2b640 1 --2- 172.21.15.63:0/992656910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c815ef00 0x7fc2c80d2c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80ba3a0 tx=0x7fc2b002a530 comp rx=0 tx=0).stop 2024-09-21T07:00:26.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.145+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/992656910 shutdown_connections 2024-09-21T07:00:26.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.145+0000 7fc2ccf2b640 1 --2- 172.21.15.63:0/992656910 >> v2:172.21.15.71:3300/0 conn(0x7fc2c80cf310 0x7fc2c80cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.145+0000 7fc2ccf2b640 1 --2- 172.21.15.63:0/992656910 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c815ef00 0x7fc2c80d2c40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.145+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/992656910 >> 172.21.15.63:0/992656910 conn(0x7fc2c808bfd0 msgr2=0x7fc2c80d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:26.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.145+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/992656910 shutdown_connections 2024-09-21T07:00:26.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.145+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/992656910 wait complete. 2024-09-21T07:00:26.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.147+0000 7fc2ccf2b640 1 Processor -- start 2024-09-21T07:00:26.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.147+0000 7fc2ccf2b640 1 -- start start 2024-09-21T07:00:26.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.148+0000 7fc2ccf2b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c80b7530 0x7fc2c8155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:26.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2ccf2b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c80cf310 0x7fc2c815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:26.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2ccf2b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc2c815ef00 0x7fc2c815f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2ccf2b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c80cfff0 con 0x7fc2c80cf310 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2ccf2b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c80cfe70 con 0x7fc2c80b7530 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2ccf2b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c80d0170 con 0x7fc2c815ef00 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2c5d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c80cf310 0x7fc2c815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2c5d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c80cf310 0x7fc2c815f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43348/0 (socket says 172.21.15.63:43348) 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2c5d9b640 1 -- 172.21.15.63:0/1714691512 learned_addr learned my addr 172.21.15.63:0/1714691512 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2c659c640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c80b7530 0x7fc2c8155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2c6d9d640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc2c815ef00 0x7fc2c815f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2c5d9b640 1 -- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc2c815ef00 msgr2=0x7fc2c815f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2c5d9b640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc2c815ef00 0x7fc2c815f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2c5d9b640 1 -- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c80b7530 msgr2=0x7fc2c8155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2c5d9b640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c80b7530 0x7fc2c8155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2c5d9b640 1 -- 172.21.15.63:0/1714691512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c80ca7f0 con 0x7fc2c80cf310 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2c5d9b640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c80cf310 0x7fc2c815f3b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00098f0 tx=0x7fc2b0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:26.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2beffd640 1 -- 172.21.15.63:0/1714691512 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0005c90 con 0x7fc2c80cf310 2024-09-21T07:00:26.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2beffd640 1 -- 172.21.15.63:0/1714691512 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2b0031e50 con 0x7fc2c80cf310 2024-09-21T07:00:26.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2beffd640 1 -- 172.21.15.63:0/1714691512 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0005260 con 0x7fc2c80cf310 2024-09-21T07:00:26.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/1714691512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c80cb8c0 con 0x7fc2c80cf310 2024-09-21T07:00:26.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.149+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/1714691512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c80cbe80 con 0x7fc2c80cf310 2024-09-21T07:00:26.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.151+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/1714691512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2c80d0670 con 0x7fc2c80cf310 2024-09-21T07:00:26.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.151+0000 7fc2beffd640 1 -- 172.21.15.63:0/1714691512 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc2b0005400 con 0x7fc2c80cf310 2024-09-21T07:00:26.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.152+0000 7fc2beffd640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc2a8078bc0 0x7fc2a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:26.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.152+0000 7fc2beffd640 1 -- 172.21.15.63:0/1714691512 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc2b00bbe60 con 0x7fc2c80cf310 2024-09-21T07:00:26.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.152+0000 7fc2c659c640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc2a8078bc0 0x7fc2a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:26.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.152+0000 7fc2c659c640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc2a8078bc0 0x7fc2a807b0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80d4660 tx=0x7fc2c0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:26.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.156+0000 7fc2beffd640 1 -- 172.21.15.63:0/1714691512 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc2b003f030 con 0x7fc2c80cf310 2024-09-21T07:00:26.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.338+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/1714691512 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2c806a130 con 0x7fc2a8078bc0 2024-09-21T07:00:26.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.343+0000 7fc2beffd640 1 -- 172.21.15.63:0/1714691512 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241525 (secure 0 0 0) 0x7fc2c806a130 con 0x7fc2a8078bc0 2024-09-21T07:00:26.345 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:26.349 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:00:26.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.346+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc2a8078bc0 msgr2=0x7fc2a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.346+0000 7fc2ccf2b640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc2a8078bc0 0x7fc2a807b0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2c80d4660 tx=0x7fc2c0009040 comp rx=0 tx=0).stop 2024-09-21T07:00:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.346+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/1714691512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c80cf310 msgr2=0x7fc2c815f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.346+0000 7fc2ccf2b640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c80cf310 0x7fc2c815f3b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00098f0 tx=0x7fc2b0033c20 comp rx=0 tx=0).stop 2024-09-21T07:00:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.346+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/1714691512 shutdown_connections 2024-09-21T07:00:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.346+0000 7fc2ccf2b640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc2a8078bc0 0x7fc2a807b0d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.346+0000 7fc2ccf2b640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc2c815ef00 0x7fc2c815f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.346+0000 7fc2ccf2b640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2c80cf310 0x7fc2c815f3b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.346+0000 7fc2ccf2b640 1 --2- 172.21.15.63:0/1714691512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc2c80b7530 0x7fc2c8155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.346+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/1714691512 >> 172.21.15.63:0/1714691512 conn(0x7fc2c808bfd0 msgr2=0x7fc2c80d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.346+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/1714691512 shutdown_connections 2024-09-21T07:00:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.346+0000 7fc2ccf2b640 1 -- 172.21.15.63:0/1714691512 wait complete. 2024-09-21T07:00:26.358 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-21T07:00:24.597650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":120,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":80,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2608,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2670592,"data_stored":1636331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.070868"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.560284+0000","last_change":"2024-09-21T07:00:21.558126+0000","last_active":"2024-09-21T07:00:21.560284+0000","last_peered":"2024-09-21T07:00:21.560284+0000","last_clean":"2024-09-21T07:00:21.560284+0000","last_became_active":"2024-09-21T07:00:21.557784+0000","last_became_peered":"2024-09-21T07:00:21.557784+0000","last_unstale":"2024-09-21T07:00:21.560284+0000","last_undegraded":"2024-09-21T07:00:21.560284+0000","last_fullsized":"2024-09-21T07:00:21.560284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:24.273272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.530751+0000","last_change":"2024-09-21T07:00:19.530751+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.530751+0000","last_undegraded":"2024-09-21T07:00:19.530751+0000","last_fullsized":"2024-09-21T07:00:19.530751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.566798+0000","last_change":"2024-09-21T07:00:21.565217+0000","last_active":"2024-09-21T07:00:21.566798+0000","last_peered":"2024-09-21T07:00:21.566798+0000","last_clean":"2024-09-21T07:00:21.566798+0000","last_became_active":"2024-09-21T07:00:21.564900+0000","last_became_peered":"2024-09-21T07:00:21.564900+0000","last_unstale":"2024-09-21T07:00:21.566798+0000","last_undegraded":"2024-09-21T07:00:21.566798+0000","last_fullsized":"2024-09-21T07:00:21.566798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:58.663235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.536833+0000","last_change":"2024-09-21T07:00:19.536833+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.536833+0000","last_undegraded":"2024-09-21T07:00:19.536833+0000","last_fullsized":"2024-09-21T07:00:19.536833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.529569+0000","last_change":"2024-09-21T07:00:19.529569+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.529569+0000","last_undegraded":"2024-09-21T07:00:19.529569+0000","last_fullsized":"2024-09-21T07:00:19.529569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535766+0000","last_change":"2024-09-21T07:00:19.535766+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535766+0000","last_undegraded":"2024-09-21T07:00:19.535766+0000","last_fullsized":"2024-09-21T07:00:19.535766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.566659+0000","last_change":"2024-09-21T07:00:21.563091+0000","last_active":"2024-09-21T07:00:21.566659+0000","last_peered":"2024-09-21T07:00:21.566659+0000","last_clean":"2024-09-21T07:00:21.566659+0000","last_became_active":"2024-09-21T07:00:21.562811+0000","last_became_peered":"2024-09-21T07:00:21.562811+0000","last_unstale":"2024-09-21T07:00:21.566659+0000","last_undegraded":"2024-09-21T07:00:21.566659+0000","last_fullsized":"2024-09-21T07:00:21.566659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:43.401058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.533178+0000","last_change":"2024-09-21T07:00:19.533178+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.533178+0000","last_undegraded":"2024-09-21T07:00:19.533178+0000","last_fullsized":"2024-09-21T07:00:19.533178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528280+0000","last_change":"2024-09-21T07:00:19.528280+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528280+0000","last_undegraded":"2024-09-21T07:00:19.528280+0000","last_fullsized":"2024-09-21T07:00:19.528280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535278+0000","last_change":"2024-09-21T07:00:19.535278+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535278+0000","last_undegraded":"2024-09-21T07:00:19.535278+0000","last_fullsized":"2024-09-21T07:00:19.535278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.533242+0000","last_change":"2024-09-21T07:00:19.533242+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.533242+0000","last_undegraded":"2024-09-21T07:00:19.533242+0000","last_fullsized":"2024-09-21T07:00:19.533242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535195+0000","last_change":"2024-09-21T07:00:19.535195+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535195+0000","last_undegraded":"2024-09-21T07:00:19.535195+0000","last_fullsized":"2024-09-21T07:00:19.535195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.536250+0000","last_change":"2024-09-21T07:00:19.536250+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.536250+0000","last_undegraded":"2024-09-21T07:00:19.536250+0000","last_fullsized":"2024-09-21T07:00:19.536250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528627+0000","last_change":"2024-09-21T07:00:19.528627+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528627+0000","last_undegraded":"2024-09-21T07:00:19.528627+0000","last_fullsized":"2024-09-21T07:00:19.528627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.565999+0000","last_change":"2024-09-21T07:00:20.549484+0000","last_active":"2024-09-21T07:00:21.565999+0000","last_peered":"2024-09-21T07:00:21.565999+0000","last_clean":"2024-09-21T07:00:21.565999+0000","last_became_active":"2024-09-21T07:00:20.549138+0000","last_became_peered":"2024-09-21T07:00:20.549138+0000","last_unstale":"2024-09-21T07:00:21.565999+0000","last_undegraded":"2024-09-21T07:00:21.565999+0000","last_fullsized":"2024-09-21T07:00:21.565999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:49.823889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528290+0000","last_change":"2024-09-21T07:00:19.528290+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528290+0000","last_undegraded":"2024-09-21T07:00:19.528290+0000","last_fullsized":"2024-09-21T07:00:19.528290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.567632+0000","last_change":"2024-09-21T07:00:20.546640+0000","last_active":"2024-09-21T07:00:21.567632+0000","last_peered":"2024-09-21T07:00:21.567632+0000","last_clean":"2024-09-21T07:00:21.567632+0000","last_became_active":"2024-09-21T07:00:20.545583+0000","last_became_peered":"2024-09-21T07:00:20.545583+0000","last_unstale":"2024-09-21T07:00:21.567632+0000","last_undegraded":"2024-09-21T07:00:21.567632+0000","last_fullsized":"2024-09-21T07:00:21.567632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:24.006199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.532284+0000","last_change":"2024-09-21T07:00:19.532284+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.532284+0000","last_undegraded":"2024-09-21T07:00:19.532284+0000","last_fullsized":"2024-09-21T07:00:19.532284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.529881+0000","last_change":"2024-09-21T07:00:19.529881+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.529881+0000","last_undegraded":"2024-09-21T07:00:19.529881+0000","last_fullsized":"2024-09-21T07:00:19.529881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":105,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-21T07:00:19.534987+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:00:19.534987+0000","last_peered":"2024-09-21T07:00:19.534987+0000","last_clean":"2024-09-21T07:00:19.534987+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:00:19.534987+0000","last_undegraded":"2024-09-21T07:00:19.534987+0000","last_fullsized":"2024-09-21T07:00:19.534987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.533641+0000","last_change":"2024-09-21T07:00:19.533641+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.533641+0000","last_undegraded":"2024-09-21T07:00:19.533641+0000","last_fullsized":"2024-09-21T07:00:19.533641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.560140+0000","last_change":"2024-09-21T07:00:21.555846+0000","last_active":"2024-09-21T07:00:21.560140+0000","last_peered":"2024-09-21T07:00:21.560140+0000","last_clean":"2024-09-21T07:00:21.560140+0000","last_became_active":"2024-09-21T07:00:21.555489+0000","last_became_peered":"2024-09-21T07:00:21.555489+0000","last_unstale":"2024-09-21T07:00:21.560140+0000","last_undegraded":"2024-09-21T07:00:21.560140+0000","last_fullsized":"2024-09-21T07:00:21.560140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:20.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.534788+0000","last_change":"2024-09-21T07:00:19.534788+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.534788+0000","last_undegraded":"2024-09-21T07:00:19.534788+0000","last_fullsized":"2024-09-21T07:00:19.534788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535191+0000","last_change":"2024-09-21T07:00:19.535191+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535191+0000","last_undegraded":"2024-09-21T07:00:19.535191+0000","last_fullsized":"2024-09-21T07:00:19.535191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.534296+0000","last_change":"2024-09-21T07:00:19.534296+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.534296+0000","last_undegraded":"2024-09-21T07:00:19.534296+0000","last_fullsized":"2024-09-21T07:00:19.534296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.531445+0000","last_change":"2024-09-21T07:00:19.531445+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.531445+0000","last_undegraded":"2024-09-21T07:00:19.531445+0000","last_fullsized":"2024-09-21T07:00:19.531445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.534768+0000","last_change":"2024-09-21T07:00:19.534768+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.534768+0000","last_undegraded":"2024-09-21T07:00:19.534768+0000","last_fullsized":"2024-09-21T07:00:19.534768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.542399+0000","last_change":"2024-09-21T07:00:20.555344+0000","last_active":"2024-09-21T07:00:21.542399+0000","last_peered":"2024-09-21T07:00:21.542399+0000","last_clean":"2024-09-21T07:00:21.542399+0000","last_became_active":"2024-09-21T07:00:20.555062+0000","last_became_peered":"2024-09-21T07:00:20.555062+0000","last_unstale":"2024-09-21T07:00:21.542399+0000","last_undegraded":"2024-09-21T07:00:21.542399+0000","last_fullsized":"2024-09-21T07:00:21.542399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:48.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.559978+0000","last_change":"2024-09-21T07:00:21.555637+0000","last_active":"2024-09-21T07:00:21.559978+0000","last_peered":"2024-09-21T07:00:21.559978+0000","last_clean":"2024-09-21T07:00:21.559978+0000","last_became_active":"2024-09-21T07:00:21.554035+0000","last_became_peered":"2024-09-21T07:00:21.554035+0000","last_unstale":"2024-09-21T07:00:21.559978+0000","last_undegraded":"2024-09-21T07:00:21.559978+0000","last_fullsized":"2024-09-21T07:00:21.559978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:31.094122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.535328+0000","last_change":"2024-09-21T07:00:19.535328+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.535328+0000","last_undegraded":"2024-09-21T07:00:19.535328+0000","last_fullsized":"2024-09-21T07:00:19.535328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.562149+0000","last_change":"2024-09-21T07:00:21.559146+0000","last_active":"2024-09-21T07:00:21.562149+0000","last_peered":"2024-09-21T07:00:21.562149+0000","last_clean":"2024-09-21T07:00:21.562149+0000","last_became_active":"2024-09-21T07:00:21.558843+0000","last_became_peered":"2024-09-21T07:00:21.558843+0000","last_unstale":"2024-09-21T07:00:21.562149+0000","last_undegraded":"2024-09-21T07:00:21.562149+0000","last_fullsized":"2024-09-21T07:00:21.562149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:35.286384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528283+0000","last_change":"2024-09-21T07:00:19.528283+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528283+0000","last_undegraded":"2024-09-21T07:00:19.528283+0000","last_fullsized":"2024-09-21T07:00:19.528283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.541794+0000","last_change":"2024-09-21T07:00:20.554018+0000","last_active":"2024-09-21T07:00:21.541794+0000","last_peered":"2024-09-21T07:00:21.541794+0000","last_clean":"2024-09-21T07:00:21.541794+0000","last_became_active":"2024-09-21T07:00:20.553671+0000","last_became_peered":"2024-09-21T07:00:20.553671+0000","last_unstale":"2024-09-21T07:00:21.541794+0000","last_undegraded":"2024-09-21T07:00:21.541794+0000","last_fullsized":"2024-09-21T07:00:21.541794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:05.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.560341+0000","last_change":"2024-09-21T07:00:21.557634+0000","last_active":"2024-09-21T07:00:21.560341+0000","last_peered":"2024-09-21T07:00:21.560341+0000","last_clean":"2024-09-21T07:00:21.560341+0000","last_became_active":"2024-09-21T07:00:21.557321+0000","last_became_peered":"2024-09-21T07:00:21.557321+0000","last_unstale":"2024-09-21T07:00:21.560341+0000","last_undegraded":"2024-09-21T07:00:21.560341+0000","last_fullsized":"2024-09-21T07:00:21.560341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:54.847595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.530357+0000","last_change":"2024-09-21T07:00:19.530357+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.530357+0000","last_undegraded":"2024-09-21T07:00:19.530357+0000","last_fullsized":"2024-09-21T07:00:19.530357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.534453+0000","last_change":"2024-09-21T07:00:19.534453+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.534453+0000","last_undegraded":"2024-09-21T07:00:19.534453+0000","last_fullsized":"2024-09-21T07:00:19.534453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528508+0000","last_change":"2024-09-21T07:00:19.528508+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528508+0000","last_undegraded":"2024-09-21T07:00:19.528508+0000","last_fullsized":"2024-09-21T07:00:19.528508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.528783+0000","last_change":"2024-09-21T07:00:19.528783+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.528783+0000","last_undegraded":"2024-09-21T07:00:19.528783+0000","last_fullsized":"2024-09-21T07:00:19.528783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-21T07:00:19.532167+0000","last_change":"2024-09-21T07:00:19.532167+0000","last_active":"2024-09-21T07:00:19.518385+0000","last_peered":"2024-09-21T07:00:19.518385+0000","last_clean":"2024-09-21T07:00:19.518385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:19.532167+0000","last_undegraded":"2024-09-21T07:00:19.532167+0000","last_fullsized":"2024-09-21T07:00:19.532167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:00:20.523930+0000","last_change":"2024-09-21T07:00:20.523930+0000","last_active":"2024-09-21T07:00:20.523930+0000","last_peered":"2024-09-21T07:00:20.523930+0000","last_clean":"2024-09-21T07:00:20.523930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:00:20.523930+0000","last_undegraded":"2024-09-21T07:00:20.523930+0000","last_fullsized":"2024-09-21T07:00:20.523930+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.568036+0000","last_change":"2024-09-21T07:00:20.544364+0000","last_active":"2024-09-21T07:00:21.568036+0000","last_peered":"2024-09-21T07:00:21.568036+0000","last_clean":"2024-09-21T07:00:21.568036+0000","last_became_active":"2024-09-21T07:00:20.543152+0000","last_became_peered":"2024-09-21T07:00:20.543152+0000","last_unstale":"2024-09-21T07:00:21.568036+0000","last_undegraded":"2024-09-21T07:00:21.568036+0000","last_fullsized":"2024-09-21T07:00:21.568036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:24.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":765952,"data_stored":641765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":57214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":51397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":647582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":51397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":72548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:00:26.362 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-21T07:00:26.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.362 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-21T07:00:26.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.362 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-21T07:00:26.362 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.362 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-21T07:00:26.363 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.363 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-21T07:00:26.363 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.363 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-21T07:00:26.363 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.363 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-21T07:00:26.363 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.363 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-21T07:00:26.363 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.363 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-21T07:00:26.363 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.363 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-21T07:00:26.364 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.364 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-21T07:00:26.364 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.364 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-21T07:00:26.364 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.364 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-21T07:00:26.364 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.364 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-21T07:00:26.364 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.364 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-21T07:00:26.364 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.364 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-21T07:00:26.365 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.365 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-21T07:00:26.365 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.365 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-21T07:00:26.365 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.365 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-21T07:00:26.365 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.365 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-21T07:00:26.365 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.365 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-21T07:00:26.365 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.365 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-21T07:00:26.365 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.366 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-21T07:00:26.366 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.366 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-21T07:00:26.366 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.366 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-21T07:00:26.366 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.366 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-21T07:00:26.366 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.366 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-21T07:00:26.366 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.366 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-21T07:00:26.366 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.367 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-21T07:00:26.367 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.367 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-21T07:00:26.367 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.367 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-21T07:00:26.367 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.367 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-21T07:00:26.367 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.367 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1b is not active+clean 2024-09-21T07:00:26.367 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.530751+0000', 'last_change': '2024-09-21T07:00:19.530751+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.530751+0000', 'last_undegraded': '2024-09-21T07:00:19.530751+0000', 'last_fullsized': '2024-09-21T07:00:19.530751+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:00:26.367 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-21T07:00:26.368 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.536833+0000', 'last_change': '2024-09-21T07:00:19.536833+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.536833+0000', 'last_undegraded': '2024-09-21T07:00:19.536833+0000', 'last_fullsized': '2024-09-21T07:00:19.536833+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:00:26.368 INFO:tasks.ceph.ceph_manager.ceph:PG 2.19 is not active+clean 2024-09-21T07:00:26.368 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.529569+0000', 'last_change': '2024-09-21T07:00:19.529569+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.529569+0000', 'last_undegraded': '2024-09-21T07:00:19.529569+0000', 'last_fullsized': '2024-09-21T07:00:19.529569+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:00:26.368 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-21T07:00:26.368 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.368 INFO:tasks.ceph.ceph_manager.ceph:PG 2.18 is not active+clean 2024-09-21T07:00:26.368 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.535766+0000', 'last_change': '2024-09-21T07:00:19.535766+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.535766+0000', 'last_undegraded': '2024-09-21T07:00:19.535766+0000', 'last_fullsized': '2024-09-21T07:00:19.535766+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:00:26.368 INFO:tasks.ceph.ceph_manager.ceph:PG 2.17 is not active+clean 2024-09-21T07:00:26.368 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.533178+0000', 'last_change': '2024-09-21T07:00:19.533178+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.533178+0000', 'last_undegraded': '2024-09-21T07:00:19.533178+0000', 'last_fullsized': '2024-09-21T07:00:19.533178+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-21T07:00:26.368 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-21T07:00:26.368 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.369 INFO:tasks.ceph.ceph_manager.ceph:PG 2.16 is not active+clean 2024-09-21T07:00:26.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.528280+0000', 'last_change': '2024-09-21T07:00:19.528280+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.528280+0000', 'last_undegraded': '2024-09-21T07:00:19.528280+0000', 'last_fullsized': '2024-09-21T07:00:19.528280+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:00:26.369 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-21T07:00:26.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.369 INFO:tasks.ceph.ceph_manager.ceph:PG 2.15 is not active+clean 2024-09-21T07:00:26.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.535278+0000', 'last_change': '2024-09-21T07:00:19.535278+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.535278+0000', 'last_undegraded': '2024-09-21T07:00:19.535278+0000', 'last_fullsized': '2024-09-21T07:00:19.535278+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:00:26.369 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-21T07:00:26.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.369 INFO:tasks.ceph.ceph_manager.ceph:PG 2.14 is not active+clean 2024-09-21T07:00:26.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.533242+0000', 'last_change': '2024-09-21T07:00:19.533242+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.533242+0000', 'last_undegraded': '2024-09-21T07:00:19.533242+0000', 'last_fullsized': '2024-09-21T07:00:19.533242+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-21T07:00:26.369 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-21T07:00:26.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.370 INFO:tasks.ceph.ceph_manager.ceph:PG 2.13 is not active+clean 2024-09-21T07:00:26.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.535195+0000', 'last_change': '2024-09-21T07:00:19.535195+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.535195+0000', 'last_undegraded': '2024-09-21T07:00:19.535195+0000', 'last_fullsized': '2024-09-21T07:00:19.535195+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:00:26.370 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-21T07:00:26.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.370 INFO:tasks.ceph.ceph_manager.ceph:PG 2.12 is not active+clean 2024-09-21T07:00:26.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.536250+0000', 'last_change': '2024-09-21T07:00:19.536250+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.536250+0000', 'last_undegraded': '2024-09-21T07:00:19.536250+0000', 'last_fullsized': '2024-09-21T07:00:19.536250+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:00:26.370 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-21T07:00:26.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.370 INFO:tasks.ceph.ceph_manager.ceph:PG 2.11 is not active+clean 2024-09-21T07:00:26.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.528627+0000', 'last_change': '2024-09-21T07:00:19.528627+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.528627+0000', 'last_undegraded': '2024-09-21T07:00:19.528627+0000', 'last_fullsized': '2024-09-21T07:00:19.528627+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:00:26.371 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-21T07:00:26.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.371 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-21T07:00:26.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.371 INFO:tasks.ceph.ceph_manager.ceph:PG 2.f is not active+clean 2024-09-21T07:00:26.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.528290+0000', 'last_change': '2024-09-21T07:00:19.528290+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.528290+0000', 'last_undegraded': '2024-09-21T07:00:19.528290+0000', 'last_fullsized': '2024-09-21T07:00:19.528290+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:00:26.371 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-21T07:00:26.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.371 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-21T07:00:26.371 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.372 INFO:tasks.ceph.ceph_manager.ceph:PG 2.d is not active+clean 2024-09-21T07:00:26.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.532284+0000', 'last_change': '2024-09-21T07:00:19.532284+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.532284+0000', 'last_undegraded': '2024-09-21T07:00:19.532284+0000', 'last_fullsized': '2024-09-21T07:00:19.532284+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:00:26.372 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-21T07:00:26.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.372 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-21T07:00:26.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.529881+0000', 'last_change': '2024-09-21T07:00:19.529881+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.529881+0000', 'last_undegraded': '2024-09-21T07:00:19.529881+0000', 'last_fullsized': '2024-09-21T07:00:19.529881+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:00:26.372 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-21T07:00:26.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.372 INFO:tasks.ceph.ceph_manager.ceph:PG 2.3 is not active+clean 2024-09-21T07:00:26.372 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.533641+0000', 'last_change': '2024-09-21T07:00:19.533641+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.533641+0000', 'last_undegraded': '2024-09-21T07:00:19.533641+0000', 'last_fullsized': '2024-09-21T07:00:19.533641+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:00:26.373 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-21T07:00:26.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.534788+0000', 'last_change': '2024-09-21T07:00:19.534788+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.534788+0000', 'last_undegraded': '2024-09-21T07:00:19.534788+0000', 'last_fullsized': '2024-09-21T07:00:19.534788+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:00:26.373 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-21T07:00:26.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.373 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-21T07:00:26.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.535191+0000', 'last_change': '2024-09-21T07:00:19.535191+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.535191+0000', 'last_undegraded': '2024-09-21T07:00:19.535191+0000', 'last_fullsized': '2024-09-21T07:00:19.535191+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-21T07:00:26.373 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-21T07:00:26.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.373 INFO:tasks.ceph.ceph_manager.ceph:PG 2.2 is not active+clean 2024-09-21T07:00:26.373 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.534296+0000', 'last_change': '2024-09-21T07:00:19.534296+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.534296+0000', 'last_undegraded': '2024-09-21T07:00:19.534296+0000', 'last_fullsized': '2024-09-21T07:00:19.534296+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:00:26.374 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-21T07:00:26.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.374 INFO:tasks.ceph.ceph_manager.ceph:PG 2.4 is not active+clean 2024-09-21T07:00:26.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.531445+0000', 'last_change': '2024-09-21T07:00:19.531445+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.531445+0000', 'last_undegraded': '2024-09-21T07:00:19.531445+0000', 'last_fullsized': '2024-09-21T07:00:19.531445+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:00:26.374 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-21T07:00:26.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.374 INFO:tasks.ceph.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-21T07:00:26.374 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.534768+0000', 'last_change': '2024-09-21T07:00:19.534768+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.534768+0000', 'last_undegraded': '2024-09-21T07:00:19.534768+0000', 'last_fullsized': '2024-09-21T07:00:19.534768+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:00:26.375 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-21T07:00:26.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.375 INFO:tasks.ceph.ceph_manager.ceph:PG 2.7 is not active+clean 2024-09-21T07:00:26.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.535328+0000', 'last_change': '2024-09-21T07:00:19.535328+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.535328+0000', 'last_undegraded': '2024-09-21T07:00:19.535328+0000', 'last_fullsized': '2024-09-21T07:00:19.535328+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:00:26.375 INFO:tasks.ceph.ceph_manager.ceph:PG 2.8 is not active+clean 2024-09-21T07:00:26.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.528283+0000', 'last_change': '2024-09-21T07:00:19.528283+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.528283+0000', 'last_undegraded': '2024-09-21T07:00:19.528283+0000', 'last_fullsized': '2024-09-21T07:00:19.528283+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:00:26.375 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-21T07:00:26.375 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.376 INFO:tasks.ceph.ceph_manager.ceph:PG 2.a is not active+clean 2024-09-21T07:00:26.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.530357+0000', 'last_change': '2024-09-21T07:00:19.530357+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.530357+0000', 'last_undegraded': '2024-09-21T07:00:19.530357+0000', 'last_fullsized': '2024-09-21T07:00:19.530357+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-21T07:00:26.376 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-21T07:00:26.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.376 INFO:tasks.ceph.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-21T07:00:26.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.534453+0000', 'last_change': '2024-09-21T07:00:19.534453+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.534453+0000', 'last_undegraded': '2024-09-21T07:00:19.534453+0000', 'last_fullsized': '2024-09-21T07:00:19.534453+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-21T07:00:26.376 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-21T07:00:26.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.376 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-21T07:00:26.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.377 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-21T07:00:26.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.528508+0000', 'last_change': '2024-09-21T07:00:19.528508+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.528508+0000', 'last_undegraded': '2024-09-21T07:00:19.528508+0000', 'last_fullsized': '2024-09-21T07:00:19.528508+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:00:26.377 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-21T07:00:26.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.377 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1d is not active+clean 2024-09-21T07:00:26.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.528783+0000', 'last_change': '2024-09-21T07:00:19.528783+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.528783+0000', 'last_undegraded': '2024-09-21T07:00:19.528783+0000', 'last_fullsized': '2024-09-21T07:00:19.528783+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-21T07:00:26.377 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-21T07:00:26.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.377 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1e is not active+clean 2024-09-21T07:00:26.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:00:19.532167+0000', 'last_change': '2024-09-21T07:00:19.532167+0000', 'last_active': '2024-09-21T07:00:19.518385+0000', 'last_peered': '2024-09-21T07:00:19.518385+0000', 'last_clean': '2024-09-21T07:00:19.518385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:19.532167+0000', 'last_undegraded': '2024-09-21T07:00:19.532167+0000', 'last_fullsized': '2024-09-21T07:00:19.532167+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:19.518385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T07:00:26.378 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-21T07:00:26.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:00:20.523930+0000', 'last_change': '2024-09-21T07:00:20.523930+0000', 'last_active': '2024-09-21T07:00:20.523930+0000', 'last_peered': '2024-09-21T07:00:20.523930+0000', 'last_clean': '2024-09-21T07:00:20.523930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:00:20.523930+0000', 'last_undegraded': '2024-09-21T07:00:20.523930+0000', 'last_fullsized': '2024-09-21T07:00:20.523930+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'last_clean_scrub_stamp': '2024-09-21T07:00:20.523930+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:00:26.378 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:00:26.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.516+0000 7fb431af9640 1 -- 172.21.15.63:0/1150118024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb42c0b3750 msgr2=0x7fb42c09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:26.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.516+0000 7fb431af9640 1 --2- 172.21.15.63:0/1150118024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb42c0b3750 0x7fb42c09aa40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009830 tx=0x7fb41c02a510 comp rx=0 tx=0).stop 2024-09-21T07:00:26.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.516+0000 7fb431af9640 1 -- 172.21.15.63:0/1150118024 shutdown_connections 2024-09-21T07:00:26.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.516+0000 7fb431af9640 1 --2- 172.21.15.63:0/1150118024 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb42c0b3b60 0x7fb42c09af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.516+0000 7fb431af9640 1 --2- 172.21.15.63:0/1150118024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb42c0b3750 0x7fb42c09aa40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.516+0000 7fb431af9640 1 -- 172.21.15.63:0/1150118024 >> 172.21.15.63:0/1150118024 conn(0x7fb42c0b3fb0 msgr2=0x7fb42c0b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:26.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.516+0000 7fb431af9640 1 -- 172.21.15.63:0/1150118024 shutdown_connections 2024-09-21T07:00:26.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.516+0000 7fb431af9640 1 -- 172.21.15.63:0/1150118024 wait complete. 2024-09-21T07:00:26.519 INFO:tasks.ceph.mds.b.smithi071.stderr:2024-09-21T07:00:26.516+0000 7ff057e1e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:00:26.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.518+0000 7fb431af9640 1 Processor -- start 2024-09-21T07:00:26.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.518+0000 7fb431af9640 1 -- start start 2024-09-21T07:00:26.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.519+0000 7fb431af9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb42c0b3750 0x7fb42c06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:26.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.519+0000 7fb431af9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42c0b3b60 0x7fb42c1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:26.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.519+0000 7fb431af9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb42c0b6020 0x7fb42c06eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:26.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.519+0000 7fb431af9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c0ce0c0 con 0x7fb42c0b6020 2024-09-21T07:00:26.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.519+0000 7fb431af9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c0cdf40 con 0x7fb42c0b3b60 2024-09-21T07:00:26.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.519+0000 7fb431af9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb42c0ce240 con 0x7fb42c0b3750 2024-09-21T07:00:26.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.519+0000 7fb42bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb42c0b6020 0x7fb42c06eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:26.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.519+0000 7fb42bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb42c0b6020 0x7fb42c06eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43368/0 (socket says 172.21.15.63:43368) 2024-09-21T07:00:26.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.519+0000 7fb42bfff640 1 -- 172.21.15.63:0/3287328751 learned_addr learned my addr 172.21.15.63:0/3287328751 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:26.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.519+0000 7fb42b7fe640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb42c0b3750 0x7fb42c06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:26.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.519+0000 7fb42affd640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42c0b3b60 0x7fb42c1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:26.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.520+0000 7fb42bfff640 1 -- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb42c0b3750 msgr2=0x7fb42c06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:26.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.520+0000 7fb42bfff640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb42c0b3750 0x7fb42c06dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.520+0000 7fb42bfff640 1 -- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42c0b3b60 msgr2=0x7fb42c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:26.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.520+0000 7fb42bfff640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42c0b3b60 0x7fb42c1589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.520+0000 7fb42bfff640 1 -- 172.21.15.63:0/3287328751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c158ee0 con 0x7fb42c0b6020 2024-09-21T07:00:26.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.520+0000 7fb42bfff640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb42c0b6020 0x7fb42c06eb00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb42400cb10 tx=0x7fb42400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:26.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.520+0000 7fb423fff640 1 -- 172.21.15.63:0/3287328751 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424016020 con 0x7fb42c0b6020 2024-09-21T07:00:26.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.520+0000 7fb423fff640 1 -- 172.21.15.63:0/3287328751 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb42400ad80 con 0x7fb42c0b6020 2024-09-21T07:00:26.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.520+0000 7fb431af9640 1 -- 172.21.15.63:0/3287328751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42c0b2490 con 0x7fb42c0b6020 2024-09-21T07:00:26.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.520+0000 7fb423fff640 1 -- 172.21.15.63:0/3287328751 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424012680 con 0x7fb42c0b6020 2024-09-21T07:00:26.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.520+0000 7fb431af9640 1 -- 172.21.15.63:0/3287328751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42c0b2a50 con 0x7fb42c0b6020 2024-09-21T07:00:26.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.521+0000 7fb431af9640 1 -- 172.21.15.63:0/3287328751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb42c0ce760 con 0x7fb42c0b6020 2024-09-21T07:00:26.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.522+0000 7fb423fff640 1 -- 172.21.15.63:0/3287328751 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb424019020 con 0x7fb42c0b6020 2024-09-21T07:00:26.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.522+0000 7fb423fff640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb40c078bc0 0x7fb40c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:26.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.522+0000 7fb423fff640 1 -- 172.21.15.63:0/3287328751 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb42409b1b0 con 0x7fb42c0b6020 2024-09-21T07:00:26.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.523+0000 7fb42b7fe640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb40c078bc0 0x7fb40c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:26.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.523+0000 7fb42b7fe640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb40c078bc0 0x7fb40c07b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb41c034000 tx=0x7fb41c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:26.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.527+0000 7fb423fff640 1 -- 172.21.15.63:0/3287328751 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb424020020 con 0x7fb42c0b6020 2024-09-21T07:00:26.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.787+0000 7fb431af9640 1 -- 172.21.15.63:0/3287328751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb42c06a130 con 0x7fb42c0b6020 2024-09-21T07:00:26.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.787+0000 7fb423fff640 1 -- 172.21.15.63:0/3287328751 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1213 (secure 0 0 0) 0x7fb424063710 con 0x7fb42c0b6020 2024-09-21T07:00:26.789 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:26.789 INFO:teuthology.orchestra.run.smithi063.stdout:{"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1726902009,"num_in_osds":8,"osd_in_since":1726901999,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":57},{"state_name":"creating+peering","count":27},{"state_name":"active+clean","count":13}],"num_pgs":97,"num_pools":3,"num_objects":9,"data_bytes":590950,"bytes_used":224362496,"bytes_avail":772869750784,"bytes_total":773094113280,"unknown_pgs_ratio":0.58762884140014648,"inactive_pgs_ratio":0.27835050225257874,"write_bytes_sec":201,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":8,"btime":"2024-09-21T07:00:24:568573+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4410}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-21T06:59:56.217727+0000","services":{}},"progress_events":{}} 2024-09-21T07:00:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.789+0000 7fb431af9640 1 -- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb40c078bc0 msgr2=0x7fb40c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.789+0000 7fb431af9640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb40c078bc0 0x7fb40c07b0d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb41c034000 tx=0x7fb41c004730 comp rx=0 tx=0).stop 2024-09-21T07:00:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.789+0000 7fb431af9640 1 -- 172.21.15.63:0/3287328751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb42c0b6020 msgr2=0x7fb42c06eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:26.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.789+0000 7fb431af9640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb42c0b6020 0x7fb42c06eb00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb42400cb10 tx=0x7fb42400a060 comp rx=0 tx=0).stop 2024-09-21T07:00:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.789+0000 7fb431af9640 1 -- 172.21.15.63:0/3287328751 shutdown_connections 2024-09-21T07:00:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.789+0000 7fb431af9640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb40c078bc0 0x7fb40c07b0d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.789+0000 7fb431af9640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb42c0b6020 0x7fb42c06eb00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.789+0000 7fb431af9640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb42c0b3b60 0x7fb42c1589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.789+0000 7fb431af9640 1 --2- 172.21.15.63:0/3287328751 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb42c0b3750 0x7fb42c06dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.789+0000 7fb431af9640 1 -- 172.21.15.63:0/3287328751 >> 172.21.15.63:0/3287328751 conn(0x7fb42c0b3fb0 msgr2=0x7fb42c09c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.789+0000 7fb431af9640 1 -- 172.21.15.63:0/3287328751 shutdown_connections 2024-09-21T07:00:26.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.789+0000 7fb431af9640 1 -- 172.21.15.63:0/3287328751 wait complete. 2024-09-21T07:00:26.802 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:00:26.802 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:00:26.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.916+0000 7efcc2b8e640 1 -- 172.21.15.63:0/1190864133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcbc0b7530 msgr2=0x7efcbc0d2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:26.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.916+0000 7efcc2b8e640 1 --2- 172.21.15.63:0/1190864133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcbc0b7530 0x7efcbc0d2530 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efcac0098e0 tx=0x7efcac02a5d0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.916+0000 7efcc2b8e640 1 -- 172.21.15.63:0/1190864133 shutdown_connections 2024-09-21T07:00:26.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.916+0000 7efcc2b8e640 1 --2- 172.21.15.63:0/1190864133 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcbc0cf310 0x7efcbc0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.916+0000 7efcc2b8e640 1 --2- 172.21.15.63:0/1190864133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcbc0b7530 0x7efcbc0d2530 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.916+0000 7efcc2b8e640 1 -- 172.21.15.63:0/1190864133 >> 172.21.15.63:0/1190864133 conn(0x7efcbc08bfd0 msgr2=0x7efcbc0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:26.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.916+0000 7efcc2b8e640 1 -- 172.21.15.63:0/1190864133 shutdown_connections 2024-09-21T07:00:26.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.916+0000 7efcc2b8e640 1 -- 172.21.15.63:0/1190864133 wait complete. 2024-09-21T07:00:26.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.917+0000 7efcc2b8e640 1 Processor -- start 2024-09-21T07:00:26.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.917+0000 7efcc2b8e640 1 -- start start 2024-09-21T07:00:26.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcc2b8e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc0b7530 0x7efcbc1f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:26.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcc2b8e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcbc0cf310 0x7efcbc159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:26.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcc2b8e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcbc15ef00 0x7efcbc0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:26.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcc2b8e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc0cfff0 con 0x7efcbc0cf310 2024-09-21T07:00:26.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcc2b8e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efcbc0cfe70 con 0x7efcbc0b7530 2024-09-21T07:00:26.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcc2b8e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7efcbc0d0170 con 0x7efcbc15ef00 2024-09-21T07:00:26.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcbbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcbc0cf310 0x7efcbc159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:26.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcbbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcbc0cf310 0x7efcbc159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43392/0 (socket says 172.21.15.63:43392) 2024-09-21T07:00:26.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcbbfff640 1 -- 172.21.15.63:0/2850783235 learned_addr learned my addr 172.21.15.63:0/2850783235 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:26.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcc112b640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcbc15ef00 0x7efcbc0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:26.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcc092a640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc0b7530 0x7efcbc1f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:26.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcbbfff640 1 -- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcbc15ef00 msgr2=0x7efcbc0ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:26.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcbbfff640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcbc15ef00 0x7efcbc0ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcbbfff640 1 -- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc0b7530 msgr2=0x7efcbc1f6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:26.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcbbfff640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc0b7530 0x7efcbc1f6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:26.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcbbfff640 1 -- 172.21.15.63:0/2850783235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcbc15a080 con 0x7efcbc0cf310 2024-09-21T07:00:26.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.919+0000 7efcc092a640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc0b7530 0x7efcbc1f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:00:26.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.920+0000 7efcbbfff640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcbc0cf310 0x7efcbc159b40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efcb000c3c0 tx=0x7efcb000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:26.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.920+0000 7efcb97fa640 1 -- 172.21.15.63:0/2850783235 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0017070 con 0x7efcbc0cf310 2024-09-21T07:00:26.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.920+0000 7efcb97fa640 1 -- 172.21.15.63:0/2850783235 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcb00035f0 con 0x7efcbc0cf310 2024-09-21T07:00:26.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.920+0000 7efcb97fa640 1 -- 172.21.15.63:0/2850783235 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0003a80 con 0x7efcbc0cf310 2024-09-21T07:00:26.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.920+0000 7efcc2b8e640 1 -- 172.21.15.63:0/2850783235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcbc0c9040 con 0x7efcbc0cf310 2024-09-21T07:00:26.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.920+0000 7efcc2b8e640 1 -- 172.21.15.63:0/2850783235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcbc0ce500 con 0x7efcbc0cf310 2024-09-21T07:00:26.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.921+0000 7efcc2b8e640 1 -- 172.21.15.63:0/2850783235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcbc0d0700 con 0x7efcbc0cf310 2024-09-21T07:00:26.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.922+0000 7efcb97fa640 1 -- 172.21.15.63:0/2850783235 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efcb001a070 con 0x7efcbc0cf310 2024-09-21T07:00:26.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.922+0000 7efcb97fa640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7efca8078b90 0x7efca807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:26.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.923+0000 7efcc092a640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7efca8078b90 0x7efca807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:26.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.923+0000 7efcb97fa640 1 -- 172.21.15.63:0/2850783235 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efcb009a000 con 0x7efcbc0cf310 2024-09-21T07:00:26.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.923+0000 7efcc092a640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7efca8078b90 0x7efca807b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efcac034000 tx=0x7efcac004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:26.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:26.927+0000 7efcb97fa640 1 -- 172.21.15.63:0/2850783235 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7efcb00624d0 con 0x7efcbc0cf310 2024-09-21T07:00:27.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.110+0000 7efcc2b8e640 1 -- 172.21.15.63:0/2850783235 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efcbc15b1e0 con 0x7efca8078b90 2024-09-21T07:00:27.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.115+0000 7efcb97fa640 1 -- 172.21.15.63:0/2850783235 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251932 (secure 0 0 0) 0x7efcbc15b1e0 con 0x7efca8078b90 2024-09-21T07:00:27.119 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:27.120 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:00:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.118+0000 7efcc2b8e640 1 -- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7efca8078b90 msgr2=0x7efca807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.118+0000 7efcc2b8e640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7efca8078b90 0x7efca807b0a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efcac034000 tx=0x7efcac004730 comp rx=0 tx=0).stop 2024-09-21T07:00:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.118+0000 7efcc2b8e640 1 -- 172.21.15.63:0/2850783235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcbc0cf310 msgr2=0x7efcbc159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.118+0000 7efcc2b8e640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcbc0cf310 0x7efcbc159b40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efcb000c3c0 tx=0x7efcb000c880 comp rx=0 tx=0).stop 2024-09-21T07:00:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.118+0000 7efcc2b8e640 1 -- 172.21.15.63:0/2850783235 shutdown_connections 2024-09-21T07:00:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.118+0000 7efcc2b8e640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7efca8078b90 0x7efca807b0a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.118+0000 7efcc2b8e640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7efcbc15ef00 0x7efcbc0ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.118+0000 7efcc2b8e640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcbc0cf310 0x7efcbc159b40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.118+0000 7efcc2b8e640 1 --2- 172.21.15.63:0/2850783235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efcbc0b7530 0x7efcbc1f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.118+0000 7efcc2b8e640 1 -- 172.21.15.63:0/2850783235 >> 172.21.15.63:0/2850783235 conn(0x7efcbc08bfd0 msgr2=0x7efcbc0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.118+0000 7efcc2b8e640 1 -- 172.21.15.63:0/2850783235 shutdown_connections 2024-09-21T07:00:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:27.118+0000 7efcc2b8e640 1 -- 172.21.15.63:0/2850783235 wait complete. 2024-09-21T07:00:27.131 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-21T07:00:26.598212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219220,"kb_used_data":2940,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755500,"statfs":{"total":773094113280,"available":772869632000,"internally_reserved":0,"allocated":3010560,"data_stored":1791768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.065982"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679263+0000","last_change":"2024-09-21T07:00:21.563189+0000","last_active":"2024-09-21T07:00:22.679263+0000","last_peered":"2024-09-21T07:00:22.679263+0000","last_clean":"2024-09-21T07:00:22.679263+0000","last_became_active":"2024-09-21T07:00:21.562870+0000","last_became_peered":"2024-09-21T07:00:21.562870+0000","last_unstale":"2024-09-21T07:00:22.679263+0000","last_undegraded":"2024-09-21T07:00:22.679263+0000","last_fullsized":"2024-09-21T07:00:22.679263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:10.283749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679665+0000","last_change":"2024-09-21T07:00:21.562578+0000","last_active":"2024-09-21T07:00:22.679665+0000","last_peered":"2024-09-21T07:00:22.679665+0000","last_clean":"2024-09-21T07:00:22.679665+0000","last_became_active":"2024-09-21T07:00:21.560210+0000","last_became_peered":"2024-09-21T07:00:21.560210+0000","last_unstale":"2024-09-21T07:00:22.679665+0000","last_undegraded":"2024-09-21T07:00:22.679665+0000","last_fullsized":"2024-09-21T07:00:22.679665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:21.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679819+0000","last_change":"2024-09-21T07:00:21.558740+0000","last_active":"2024-09-21T07:00:22.679819+0000","last_peered":"2024-09-21T07:00:22.679819+0000","last_clean":"2024-09-21T07:00:22.679819+0000","last_became_active":"2024-09-21T07:00:21.558262+0000","last_became_peered":"2024-09-21T07:00:21.558262+0000","last_unstale":"2024-09-21T07:00:22.679819+0000","last_undegraded":"2024-09-21T07:00:22.679819+0000","last_fullsized":"2024-09-21T07:00:22.679819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:13.795076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559508+0000","last_change":"2024-09-21T07:00:21.572137+0000","last_active":"2024-09-21T07:00:22.559508+0000","last_peered":"2024-09-21T07:00:22.559508+0000","last_clean":"2024-09-21T07:00:22.559508+0000","last_became_active":"2024-09-21T07:00:21.571794+0000","last_became_peered":"2024-09-21T07:00:21.571794+0000","last_unstale":"2024-09-21T07:00:22.559508+0000","last_undegraded":"2024-09-21T07:00:22.559508+0000","last_fullsized":"2024-09-21T07:00:22.559508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:30.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679078+0000","last_change":"2024-09-21T07:00:21.564124+0000","last_active":"2024-09-21T07:00:22.679078+0000","last_peered":"2024-09-21T07:00:22.679078+0000","last_clean":"2024-09-21T07:00:22.679078+0000","last_became_active":"2024-09-21T07:00:21.563782+0000","last_became_peered":"2024-09-21T07:00:21.563782+0000","last_unstale":"2024-09-21T07:00:22.679078+0000","last_undegraded":"2024-09-21T07:00:22.679078+0000","last_fullsized":"2024-09-21T07:00:22.679078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:56.959773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559317+0000","last_change":"2024-09-21T07:00:21.570373+0000","last_active":"2024-09-21T07:00:22.559317+0000","last_peered":"2024-09-21T07:00:22.559317+0000","last_clean":"2024-09-21T07:00:22.559317+0000","last_became_active":"2024-09-21T07:00:21.570032+0000","last_became_peered":"2024-09-21T07:00:21.570032+0000","last_unstale":"2024-09-21T07:00:22.559317+0000","last_undegraded":"2024-09-21T07:00:22.559317+0000","last_fullsized":"2024-09-21T07:00:22.559317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:46.611937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678752+0000","last_change":"2024-09-21T07:00:21.564072+0000","last_active":"2024-09-21T07:00:22.678752+0000","last_peered":"2024-09-21T07:00:22.678752+0000","last_clean":"2024-09-21T07:00:22.678752+0000","last_became_active":"2024-09-21T07:00:21.563740+0000","last_became_peered":"2024-09-21T07:00:21.563740+0000","last_unstale":"2024-09-21T07:00:22.678752+0000","last_undegraded":"2024-09-21T07:00:22.678752+0000","last_fullsized":"2024-09-21T07:00:22.678752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:43.306215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679196+0000","last_change":"2024-09-21T07:00:21.571903+0000","last_active":"2024-09-21T07:00:22.679196+0000","last_peered":"2024-09-21T07:00:22.679196+0000","last_clean":"2024-09-21T07:00:22.679196+0000","last_became_active":"2024-09-21T07:00:21.571504+0000","last_became_peered":"2024-09-21T07:00:21.571504+0000","last_unstale":"2024-09-21T07:00:22.679196+0000","last_undegraded":"2024-09-21T07:00:22.679196+0000","last_fullsized":"2024-09-21T07:00:22.679196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:12.175330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678344+0000","last_change":"2024-09-21T07:00:21.560654+0000","last_active":"2024-09-21T07:00:22.678344+0000","last_peered":"2024-09-21T07:00:22.678344+0000","last_clean":"2024-09-21T07:00:22.678344+0000","last_became_active":"2024-09-21T07:00:21.560359+0000","last_became_peered":"2024-09-21T07:00:21.560359+0000","last_unstale":"2024-09-21T07:00:22.678344+0000","last_undegraded":"2024-09-21T07:00:22.678344+0000","last_fullsized":"2024-09-21T07:00:22.678344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:18.578209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678878+0000","last_change":"2024-09-21T07:00:21.567336+0000","last_active":"2024-09-21T07:00:22.678878+0000","last_peered":"2024-09-21T07:00:22.678878+0000","last_clean":"2024-09-21T07:00:22.678878+0000","last_became_active":"2024-09-21T07:00:21.566797+0000","last_became_peered":"2024-09-21T07:00:21.566797+0000","last_unstale":"2024-09-21T07:00:22.678878+0000","last_undegraded":"2024-09-21T07:00:22.678878+0000","last_fullsized":"2024-09-21T07:00:22.678878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:40.090374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678934+0000","last_change":"2024-09-21T07:00:21.563225+0000","last_active":"2024-09-21T07:00:22.678934+0000","last_peered":"2024-09-21T07:00:22.678934+0000","last_clean":"2024-09-21T07:00:22.678934+0000","last_became_active":"2024-09-21T07:00:21.560365+0000","last_became_peered":"2024-09-21T07:00:21.560365+0000","last_unstale":"2024-09-21T07:00:22.678934+0000","last_undegraded":"2024-09-21T07:00:22.678934+0000","last_fullsized":"2024-09-21T07:00:22.678934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:39.852924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678783+0000","last_change":"2024-09-21T07:00:21.562837+0000","last_active":"2024-09-21T07:00:22.678783+0000","last_peered":"2024-09-21T07:00:22.678783+0000","last_clean":"2024-09-21T07:00:22.678783+0000","last_became_active":"2024-09-21T07:00:21.560315+0000","last_became_peered":"2024-09-21T07:00:21.560315+0000","last_unstale":"2024-09-21T07:00:22.678783+0000","last_undegraded":"2024-09-21T07:00:22.678783+0000","last_fullsized":"2024-09-21T07:00:22.678783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:34:47.707070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678905+0000","last_change":"2024-09-21T07:00:21.562487+0000","last_active":"2024-09-21T07:00:22.678905+0000","last_peered":"2024-09-21T07:00:22.678905+0000","last_clean":"2024-09-21T07:00:22.678905+0000","last_became_active":"2024-09-21T07:00:21.562191+0000","last_became_peered":"2024-09-21T07:00:21.562191+0000","last_unstale":"2024-09-21T07:00:22.678905+0000","last_undegraded":"2024-09-21T07:00:22.678905+0000","last_fullsized":"2024-09-21T07:00:22.678905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:56.671345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678874+0000","last_change":"2024-09-21T07:00:21.553283+0000","last_active":"2024-09-21T07:00:22.678874+0000","last_peered":"2024-09-21T07:00:22.678874+0000","last_clean":"2024-09-21T07:00:22.678874+0000","last_became_active":"2024-09-21T07:00:21.552964+0000","last_became_peered":"2024-09-21T07:00:21.552964+0000","last_unstale":"2024-09-21T07:00:22.678874+0000","last_undegraded":"2024-09-21T07:00:22.678874+0000","last_fullsized":"2024-09-21T07:00:22.678874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:45.103534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678984+0000","last_change":"2024-09-21T07:00:21.571890+0000","last_active":"2024-09-21T07:00:22.678984+0000","last_peered":"2024-09-21T07:00:22.678984+0000","last_clean":"2024-09-21T07:00:22.678984+0000","last_became_active":"2024-09-21T07:00:21.571519+0000","last_became_peered":"2024-09-21T07:00:21.571519+0000","last_unstale":"2024-09-21T07:00:22.678984+0000","last_undegraded":"2024-09-21T07:00:22.678984+0000","last_fullsized":"2024-09-21T07:00:22.678984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:02.733307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555427+0000","last_change":"2024-09-21T07:00:21.552279+0000","last_active":"2024-09-21T07:00:22.555427+0000","last_peered":"2024-09-21T07:00:22.555427+0000","last_clean":"2024-09-21T07:00:22.555427+0000","last_became_active":"2024-09-21T07:00:21.551937+0000","last_became_peered":"2024-09-21T07:00:21.551937+0000","last_unstale":"2024-09-21T07:00:22.555427+0000","last_undegraded":"2024-09-21T07:00:22.555427+0000","last_fullsized":"2024-09-21T07:00:22.555427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:03.253724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556346+0000","last_change":"2024-09-21T07:00:21.565756+0000","last_active":"2024-09-21T07:00:22.556346+0000","last_peered":"2024-09-21T07:00:22.556346+0000","last_clean":"2024-09-21T07:00:22.556346+0000","last_became_active":"2024-09-21T07:00:21.565449+0000","last_became_peered":"2024-09-21T07:00:21.565449+0000","last_unstale":"2024-09-21T07:00:22.556346+0000","last_undegraded":"2024-09-21T07:00:22.556346+0000","last_fullsized":"2024-09-21T07:00:22.556346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:15.636322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679671+0000","last_change":"2024-09-21T07:00:21.565470+0000","last_active":"2024-09-21T07:00:22.679671+0000","last_peered":"2024-09-21T07:00:22.679671+0000","last_clean":"2024-09-21T07:00:22.679671+0000","last_became_active":"2024-09-21T07:00:21.565119+0000","last_became_peered":"2024-09-21T07:00:21.565119+0000","last_unstale":"2024-09-21T07:00:22.679671+0000","last_undegraded":"2024-09-21T07:00:22.679671+0000","last_fullsized":"2024-09-21T07:00:22.679671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:30.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556259+0000","last_change":"2024-09-21T07:00:21.551138+0000","last_active":"2024-09-21T07:00:22.556259+0000","last_peered":"2024-09-21T07:00:22.556259+0000","last_clean":"2024-09-21T07:00:22.556259+0000","last_became_active":"2024-09-21T07:00:21.550659+0000","last_became_peered":"2024-09-21T07:00:21.550659+0000","last_unstale":"2024-09-21T07:00:22.556259+0000","last_undegraded":"2024-09-21T07:00:22.556259+0000","last_fullsized":"2024-09-21T07:00:22.556259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:40.906741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679056+0000","last_change":"2024-09-21T07:00:21.563105+0000","last_active":"2024-09-21T07:00:22.679056+0000","last_peered":"2024-09-21T07:00:22.679056+0000","last_clean":"2024-09-21T07:00:22.679056+0000","last_became_active":"2024-09-21T07:00:21.559949+0000","last_became_peered":"2024-09-21T07:00:21.559949+0000","last_unstale":"2024-09-21T07:00:22.679056+0000","last_undegraded":"2024-09-21T07:00:22.679056+0000","last_fullsized":"2024-09-21T07:00:22.679056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:02.486805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.560284+0000","last_change":"2024-09-21T07:00:21.558126+0000","last_active":"2024-09-21T07:00:21.560284+0000","last_peered":"2024-09-21T07:00:21.560284+0000","last_clean":"2024-09-21T07:00:21.560284+0000","last_became_active":"2024-09-21T07:00:21.557784+0000","last_became_peered":"2024-09-21T07:00:21.557784+0000","last_unstale":"2024-09-21T07:00:21.560284+0000","last_undegraded":"2024-09-21T07:00:21.560284+0000","last_fullsized":"2024-09-21T07:00:21.560284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:24.273272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678141+0000","last_change":"2024-09-21T07:00:21.564458+0000","last_active":"2024-09-21T07:00:22.678141+0000","last_peered":"2024-09-21T07:00:22.678141+0000","last_clean":"2024-09-21T07:00:22.678141+0000","last_became_active":"2024-09-21T07:00:21.564109+0000","last_became_peered":"2024-09-21T07:00:21.564109+0000","last_unstale":"2024-09-21T07:00:22.678141+0000","last_undegraded":"2024-09-21T07:00:22.678141+0000","last_fullsized":"2024-09-21T07:00:22.678141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:59.060831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679386+0000","last_change":"2024-09-21T07:00:21.565436+0000","last_active":"2024-09-21T07:00:22.679386+0000","last_peered":"2024-09-21T07:00:22.679386+0000","last_clean":"2024-09-21T07:00:22.679386+0000","last_became_active":"2024-09-21T07:00:21.565144+0000","last_became_peered":"2024-09-21T07:00:21.565144+0000","last_unstale":"2024-09-21T07:00:22.679386+0000","last_undegraded":"2024-09-21T07:00:22.679386+0000","last_fullsized":"2024-09-21T07:00:22.679386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:22.045462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555426+0000","last_change":"2024-09-21T07:00:21.561626+0000","last_active":"2024-09-21T07:00:22.555426+0000","last_peered":"2024-09-21T07:00:22.555426+0000","last_clean":"2024-09-21T07:00:22.555426+0000","last_became_active":"2024-09-21T07:00:21.561134+0000","last_became_peered":"2024-09-21T07:00:21.561134+0000","last_unstale":"2024-09-21T07:00:22.555426+0000","last_undegraded":"2024-09-21T07:00:22.555426+0000","last_fullsized":"2024-09-21T07:00:22.555426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:56.959773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679918+0000","last_change":"2024-09-21T07:00:21.557981+0000","last_active":"2024-09-21T07:00:22.679918+0000","last_peered":"2024-09-21T07:00:22.679918+0000","last_clean":"2024-09-21T07:00:22.679918+0000","last_became_active":"2024-09-21T07:00:21.557675+0000","last_became_peered":"2024-09-21T07:00:21.557675+0000","last_unstale":"2024-09-21T07:00:22.679918+0000","last_undegraded":"2024-09-21T07:00:22.679918+0000","last_fullsized":"2024-09-21T07:00:22.679918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:49.917053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559596+0000","last_change":"2024-09-21T07:00:21.566434+0000","last_active":"2024-09-21T07:00:22.559596+0000","last_peered":"2024-09-21T07:00:22.559596+0000","last_clean":"2024-09-21T07:00:22.559596+0000","last_became_active":"2024-09-21T07:00:21.566140+0000","last_became_peered":"2024-09-21T07:00:21.566140+0000","last_unstale":"2024-09-21T07:00:22.559596+0000","last_undegraded":"2024-09-21T07:00:22.559596+0000","last_fullsized":"2024-09-21T07:00:22.559596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:56.962006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680033+0000","last_change":"2024-09-21T07:00:21.554587+0000","last_active":"2024-09-21T07:00:22.680033+0000","last_peered":"2024-09-21T07:00:22.680033+0000","last_clean":"2024-09-21T07:00:22.680033+0000","last_became_active":"2024-09-21T07:00:21.553603+0000","last_became_peered":"2024-09-21T07:00:21.553603+0000","last_unstale":"2024-09-21T07:00:22.680033+0000","last_undegraded":"2024-09-21T07:00:22.680033+0000","last_fullsized":"2024-09-21T07:00:22.680033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:09.948521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679387+0000","last_change":"2024-09-21T07:00:21.563521+0000","last_active":"2024-09-21T07:00:22.679387+0000","last_peered":"2024-09-21T07:00:22.679387+0000","last_clean":"2024-09-21T07:00:22.679387+0000","last_became_active":"2024-09-21T07:00:21.563231+0000","last_became_peered":"2024-09-21T07:00:21.563231+0000","last_unstale":"2024-09-21T07:00:22.679387+0000","last_undegraded":"2024-09-21T07:00:22.679387+0000","last_fullsized":"2024-09-21T07:00:22.679387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:09.410925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680038+0000","last_change":"2024-09-21T07:00:21.562180+0000","last_active":"2024-09-21T07:00:22.680038+0000","last_peered":"2024-09-21T07:00:22.680038+0000","last_clean":"2024-09-21T07:00:22.680038+0000","last_became_active":"2024-09-21T07:00:21.561470+0000","last_became_peered":"2024-09-21T07:00:21.561470+0000","last_unstale":"2024-09-21T07:00:22.680038+0000","last_undegraded":"2024-09-21T07:00:22.680038+0000","last_fullsized":"2024-09-21T07:00:22.680038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:37.907222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555639+0000","last_change":"2024-09-21T07:00:21.556962+0000","last_active":"2024-09-21T07:00:22.555639+0000","last_peered":"2024-09-21T07:00:22.555639+0000","last_clean":"2024-09-21T07:00:22.555639+0000","last_became_active":"2024-09-21T07:00:21.556476+0000","last_became_peered":"2024-09-21T07:00:21.556476+0000","last_unstale":"2024-09-21T07:00:22.555639+0000","last_undegraded":"2024-09-21T07:00:22.555639+0000","last_fullsized":"2024-09-21T07:00:22.555639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:45.749731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678807+0000","last_change":"2024-09-21T07:00:21.556889+0000","last_active":"2024-09-21T07:00:22.678807+0000","last_peered":"2024-09-21T07:00:22.678807+0000","last_clean":"2024-09-21T07:00:22.678807+0000","last_became_active":"2024-09-21T07:00:21.556591+0000","last_became_peered":"2024-09-21T07:00:21.556591+0000","last_unstale":"2024-09-21T07:00:22.678807+0000","last_undegraded":"2024-09-21T07:00:22.678807+0000","last_fullsized":"2024-09-21T07:00:22.678807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:46.611937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559221+0000","last_change":"2024-09-21T07:00:21.553852+0000","last_active":"2024-09-21T07:00:22.559221+0000","last_peered":"2024-09-21T07:00:22.559221+0000","last_clean":"2024-09-21T07:00:22.559221+0000","last_became_active":"2024-09-21T07:00:21.553416+0000","last_became_peered":"2024-09-21T07:00:21.553416+0000","last_unstale":"2024-09-21T07:00:22.559221+0000","last_undegraded":"2024-09-21T07:00:22.559221+0000","last_fullsized":"2024-09-21T07:00:22.559221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:59.060831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678185+0000","last_change":"2024-09-21T07:00:21.555826+0000","last_active":"2024-09-21T07:00:22.678185+0000","last_peered":"2024-09-21T07:00:22.678185+0000","last_clean":"2024-09-21T07:00:22.678185+0000","last_became_active":"2024-09-21T07:00:21.555430+0000","last_became_peered":"2024-09-21T07:00:21.555430+0000","last_unstale":"2024-09-21T07:00:22.678185+0000","last_undegraded":"2024-09-21T07:00:22.678185+0000","last_fullsized":"2024-09-21T07:00:22.678185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:46.611937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679918+0000","last_change":"2024-09-21T07:00:20.549521+0000","last_active":"2024-09-21T07:00:22.679918+0000","last_peered":"2024-09-21T07:00:22.679918+0000","last_clean":"2024-09-21T07:00:22.679918+0000","last_became_active":"2024-09-21T07:00:20.549184+0000","last_became_peered":"2024-09-21T07:00:20.549184+0000","last_unstale":"2024-09-21T07:00:22.679918+0000","last_undegraded":"2024-09-21T07:00:22.679918+0000","last_fullsized":"2024-09-21T07:00:22.679918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:18.707436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.566798+0000","last_change":"2024-09-21T07:00:21.565217+0000","last_active":"2024-09-21T07:00:21.566798+0000","last_peered":"2024-09-21T07:00:21.566798+0000","last_clean":"2024-09-21T07:00:21.566798+0000","last_became_active":"2024-09-21T07:00:21.564900+0000","last_became_peered":"2024-09-21T07:00:21.564900+0000","last_unstale":"2024-09-21T07:00:21.566798+0000","last_undegraded":"2024-09-21T07:00:21.566798+0000","last_fullsized":"2024-09-21T07:00:21.566798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:58.663235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555720+0000","last_change":"2024-09-21T07:00:20.550510+0000","last_active":"2024-09-21T07:00:22.555720+0000","last_peered":"2024-09-21T07:00:22.555720+0000","last_clean":"2024-09-21T07:00:22.555720+0000","last_became_active":"2024-09-21T07:00:20.550109+0000","last_became_peered":"2024-09-21T07:00:20.550109+0000","last_unstale":"2024-09-21T07:00:22.555720+0000","last_undegraded":"2024-09-21T07:00:22.555720+0000","last_fullsized":"2024-09-21T07:00:22.555720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:17.572663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679063+0000","last_change":"2024-09-21T07:00:20.559604+0000","last_active":"2024-09-21T07:00:22.679063+0000","last_peered":"2024-09-21T07:00:22.679063+0000","last_clean":"2024-09-21T07:00:22.679063+0000","last_became_active":"2024-09-21T07:00:20.559313+0000","last_became_peered":"2024-09-21T07:00:20.559313+0000","last_unstale":"2024-09-21T07:00:22.679063+0000","last_undegraded":"2024-09-21T07:00:22.679063+0000","last_fullsized":"2024-09-21T07:00:22.679063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:35.935572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679467+0000","last_change":"2024-09-21T07:00:21.555824+0000","last_active":"2024-09-21T07:00:22.679467+0000","last_peered":"2024-09-21T07:00:22.679467+0000","last_clean":"2024-09-21T07:00:22.679467+0000","last_became_active":"2024-09-21T07:00:21.554777+0000","last_became_peered":"2024-09-21T07:00:21.554777+0000","last_unstale":"2024-09-21T07:00:22.679467+0000","last_undegraded":"2024-09-21T07:00:22.679467+0000","last_fullsized":"2024-09-21T07:00:22.679467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:58.019313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555503+0000","last_change":"2024-09-21T07:00:20.547960+0000","last_active":"2024-09-21T07:00:22.555503+0000","last_peered":"2024-09-21T07:00:22.555503+0000","last_clean":"2024-09-21T07:00:22.555503+0000","last_became_active":"2024-09-21T07:00:20.546833+0000","last_became_peered":"2024-09-21T07:00:20.546833+0000","last_unstale":"2024-09-21T07:00:22.555503+0000","last_undegraded":"2024-09-21T07:00:22.555503+0000","last_fullsized":"2024-09-21T07:00:22.555503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:37.528194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.566659+0000","last_change":"2024-09-21T07:00:21.563091+0000","last_active":"2024-09-21T07:00:21.566659+0000","last_peered":"2024-09-21T07:00:21.566659+0000","last_clean":"2024-09-21T07:00:21.566659+0000","last_became_active":"2024-09-21T07:00:21.562811+0000","last_became_peered":"2024-09-21T07:00:21.562811+0000","last_unstale":"2024-09-21T07:00:21.566659+0000","last_undegraded":"2024-09-21T07:00:21.566659+0000","last_fullsized":"2024-09-21T07:00:21.566659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:32:43.401058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678235+0000","last_change":"2024-09-21T07:00:20.545659+0000","last_active":"2024-09-21T07:00:22.678235+0000","last_peered":"2024-09-21T07:00:22.678235+0000","last_clean":"2024-09-21T07:00:22.678235+0000","last_became_active":"2024-09-21T07:00:20.545366+0000","last_became_peered":"2024-09-21T07:00:20.545366+0000","last_unstale":"2024-09-21T07:00:22.678235+0000","last_undegraded":"2024-09-21T07:00:22.678235+0000","last_fullsized":"2024-09-21T07:00:22.678235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:22.996288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559756+0000","last_change":"2024-09-21T07:00:21.565942+0000","last_active":"2024-09-21T07:00:22.559756+0000","last_peered":"2024-09-21T07:00:22.559756+0000","last_clean":"2024-09-21T07:00:22.559756+0000","last_became_active":"2024-09-21T07:00:21.565056+0000","last_became_peered":"2024-09-21T07:00:21.565056+0000","last_unstale":"2024-09-21T07:00:22.559756+0000","last_undegraded":"2024-09-21T07:00:22.559756+0000","last_fullsized":"2024-09-21T07:00:22.559756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:09.565013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678861+0000","last_change":"2024-09-21T07:00:20.554660+0000","last_active":"2024-09-21T07:00:22.678861+0000","last_peered":"2024-09-21T07:00:22.678861+0000","last_clean":"2024-09-21T07:00:22.678861+0000","last_became_active":"2024-09-21T07:00:20.554334+0000","last_became_peered":"2024-09-21T07:00:20.554334+0000","last_unstale":"2024-09-21T07:00:22.678861+0000","last_undegraded":"2024-09-21T07:00:22.678861+0000","last_fullsized":"2024-09-21T07:00:22.678861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:45.606392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680202+0000","last_change":"2024-09-21T07:00:21.555156+0000","last_active":"2024-09-21T07:00:22.680202+0000","last_peered":"2024-09-21T07:00:22.680202+0000","last_clean":"2024-09-21T07:00:22.680202+0000","last_became_active":"2024-09-21T07:00:21.554579+0000","last_became_peered":"2024-09-21T07:00:21.554579+0000","last_unstale":"2024-09-21T07:00:22.680202+0000","last_undegraded":"2024-09-21T07:00:22.680202+0000","last_fullsized":"2024-09-21T07:00:22.680202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:07.081855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679218+0000","last_change":"2024-09-21T07:00:20.551878+0000","last_active":"2024-09-21T07:00:22.679218+0000","last_peered":"2024-09-21T07:00:22.679218+0000","last_clean":"2024-09-21T07:00:22.679218+0000","last_became_active":"2024-09-21T07:00:20.551510+0000","last_became_peered":"2024-09-21T07:00:20.551510+0000","last_unstale":"2024-09-21T07:00:22.679218+0000","last_undegraded":"2024-09-21T07:00:22.679218+0000","last_fullsized":"2024-09-21T07:00:22.679218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:21.053297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555616+0000","last_change":"2024-09-21T07:00:21.557553+0000","last_active":"2024-09-21T07:00:22.555616+0000","last_peered":"2024-09-21T07:00:22.555616+0000","last_clean":"2024-09-21T07:00:22.555616+0000","last_became_active":"2024-09-21T07:00:21.557241+0000","last_became_peered":"2024-09-21T07:00:21.557241+0000","last_unstale":"2024-09-21T07:00:22.555616+0000","last_undegraded":"2024-09-21T07:00:22.555616+0000","last_fullsized":"2024-09-21T07:00:22.555616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:55.968830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559402+0000","last_change":"2024-09-21T07:00:20.556459+0000","last_active":"2024-09-21T07:00:22.559402+0000","last_peered":"2024-09-21T07:00:22.559402+0000","last_clean":"2024-09-21T07:00:22.559402+0000","last_became_active":"2024-09-21T07:00:20.556107+0000","last_became_peered":"2024-09-21T07:00:20.556107+0000","last_unstale":"2024-09-21T07:00:22.559402+0000","last_undegraded":"2024-09-21T07:00:22.559402+0000","last_fullsized":"2024-09-21T07:00:22.559402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:49.233183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679135+0000","last_change":"2024-09-21T07:00:21.560398+0000","last_active":"2024-09-21T07:00:22.679135+0000","last_peered":"2024-09-21T07:00:22.679135+0000","last_clean":"2024-09-21T07:00:22.679135+0000","last_became_active":"2024-09-21T07:00:21.559982+0000","last_became_peered":"2024-09-21T07:00:21.559982+0000","last_unstale":"2024-09-21T07:00:22.679135+0000","last_undegraded":"2024-09-21T07:00:22.679135+0000","last_fullsized":"2024-09-21T07:00:22.679135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:03.253724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679057+0000","last_change":"2024-09-21T07:00:20.550595+0000","last_active":"2024-09-21T07:00:22.679057+0000","last_peered":"2024-09-21T07:00:22.679057+0000","last_clean":"2024-09-21T07:00:22.679057+0000","last_became_active":"2024-09-21T07:00:20.550200+0000","last_became_peered":"2024-09-21T07:00:20.550200+0000","last_unstale":"2024-09-21T07:00:22.679057+0000","last_undegraded":"2024-09-21T07:00:22.679057+0000","last_fullsized":"2024-09-21T07:00:22.679057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:18.707436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679134+0000","last_change":"2024-09-21T07:00:21.560750+0000","last_active":"2024-09-21T07:00:22.679134+0000","last_peered":"2024-09-21T07:00:22.679134+0000","last_clean":"2024-09-21T07:00:22.679134+0000","last_became_active":"2024-09-21T07:00:21.560441+0000","last_became_peered":"2024-09-21T07:00:21.560441+0000","last_unstale":"2024-09-21T07:00:22.679134+0000","last_undegraded":"2024-09-21T07:00:22.679134+0000","last_fullsized":"2024-09-21T07:00:22.679134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.279791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555799+0000","last_change":"2024-09-21T07:00:20.544906+0000","last_active":"2024-09-21T07:00:22.555799+0000","last_peered":"2024-09-21T07:00:22.555799+0000","last_clean":"2024-09-21T07:00:22.555799+0000","last_became_active":"2024-09-21T07:00:20.544498+0000","last_became_peered":"2024-09-21T07:00:20.544498+0000","last_unstale":"2024-09-21T07:00:22.555799+0000","last_undegraded":"2024-09-21T07:00:22.555799+0000","last_fullsized":"2024-09-21T07:00:22.555799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:44.271032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555684+0000","last_change":"2024-09-21T07:00:21.564804+0000","last_active":"2024-09-21T07:00:22.555684+0000","last_peered":"2024-09-21T07:00:22.555684+0000","last_clean":"2024-09-21T07:00:22.555684+0000","last_became_active":"2024-09-21T07:00:21.561696+0000","last_became_peered":"2024-09-21T07:00:21.561696+0000","last_unstale":"2024-09-21T07:00:22.555684+0000","last_undegraded":"2024-09-21T07:00:22.555684+0000","last_fullsized":"2024-09-21T07:00:22.555684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:49.943900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678454+0000","last_change":"2024-09-21T07:00:20.557556+0000","last_active":"2024-09-21T07:00:22.678454+0000","last_peered":"2024-09-21T07:00:22.678454+0000","last_clean":"2024-09-21T07:00:22.678454+0000","last_became_active":"2024-09-21T07:00:20.557169+0000","last_became_peered":"2024-09-21T07:00:20.557169+0000","last_unstale":"2024-09-21T07:00:22.678454+0000","last_undegraded":"2024-09-21T07:00:22.678454+0000","last_fullsized":"2024-09-21T07:00:22.678454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:17.973920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678272+0000","last_change":"2024-09-21T07:00:21.561779+0000","last_active":"2024-09-21T07:00:22.678272+0000","last_peered":"2024-09-21T07:00:22.678272+0000","last_clean":"2024-09-21T07:00:22.678272+0000","last_became_active":"2024-09-21T07:00:21.559267+0000","last_became_peered":"2024-09-21T07:00:21.559267+0000","last_unstale":"2024-09-21T07:00:22.678272+0000","last_undegraded":"2024-09-21T07:00:22.678272+0000","last_fullsized":"2024-09-21T07:00:22.678272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:30.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.565999+0000","last_change":"2024-09-21T07:00:20.549484+0000","last_active":"2024-09-21T07:00:21.565999+0000","last_peered":"2024-09-21T07:00:21.565999+0000","last_clean":"2024-09-21T07:00:21.565999+0000","last_became_active":"2024-09-21T07:00:20.549138+0000","last_became_peered":"2024-09-21T07:00:20.549138+0000","last_unstale":"2024-09-21T07:00:21.565999+0000","last_undegraded":"2024-09-21T07:00:21.565999+0000","last_fullsized":"2024-09-21T07:00:21.565999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:49.823889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555525+0000","last_change":"2024-09-21T07:00:21.553588+0000","last_active":"2024-09-21T07:00:22.555525+0000","last_peered":"2024-09-21T07:00:22.555525+0000","last_clean":"2024-09-21T07:00:22.555525+0000","last_became_active":"2024-09-21T07:00:21.553198+0000","last_became_peered":"2024-09-21T07:00:21.553198+0000","last_unstale":"2024-09-21T07:00:22.555525+0000","last_undegraded":"2024-09-21T07:00:22.555525+0000","last_fullsized":"2024-09-21T07:00:22.555525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:10.283749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679331+0000","last_change":"2024-09-21T07:00:20.556500+0000","last_active":"2024-09-21T07:00:22.679331+0000","last_peered":"2024-09-21T07:00:22.679331+0000","last_clean":"2024-09-21T07:00:22.679331+0000","last_became_active":"2024-09-21T07:00:20.556193+0000","last_became_peered":"2024-09-21T07:00:20.556193+0000","last_unstale":"2024-09-21T07:00:22.679331+0000","last_undegraded":"2024-09-21T07:00:22.679331+0000","last_fullsized":"2024-09-21T07:00:22.679331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:58.055286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559733+0000","last_change":"2024-09-21T07:00:21.565347+0000","last_active":"2024-09-21T07:00:22.559733+0000","last_peered":"2024-09-21T07:00:22.559733+0000","last_clean":"2024-09-21T07:00:22.559733+0000","last_became_active":"2024-09-21T07:00:21.565023+0000","last_became_peered":"2024-09-21T07:00:21.565023+0000","last_unstale":"2024-09-21T07:00:22.559733+0000","last_undegraded":"2024-09-21T07:00:22.559733+0000","last_fullsized":"2024-09-21T07:00:22.559733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:45.276577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.567632+0000","last_change":"2024-09-21T07:00:20.546640+0000","last_active":"2024-09-21T07:00:21.567632+0000","last_peered":"2024-09-21T07:00:21.567632+0000","last_clean":"2024-09-21T07:00:21.567632+0000","last_became_active":"2024-09-21T07:00:20.545583+0000","last_became_peered":"2024-09-21T07:00:20.545583+0000","last_unstale":"2024-09-21T07:00:21.567632+0000","last_undegraded":"2024-09-21T07:00:21.567632+0000","last_fullsized":"2024-09-21T07:00:21.567632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:24.006199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679347+0000","last_change":"2024-09-21T07:00:21.562929+0000","last_active":"2024-09-21T07:00:22.679347+0000","last_peered":"2024-09-21T07:00:22.679347+0000","last_clean":"2024-09-21T07:00:22.679347+0000","last_became_active":"2024-09-21T07:00:21.560634+0000","last_became_peered":"2024-09-21T07:00:21.560634+0000","last_unstale":"2024-09-21T07:00:22.679347+0000","last_undegraded":"2024-09-21T07:00:22.679347+0000","last_fullsized":"2024-09-21T07:00:22.679347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:55.968830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679904+0000","last_change":"2024-09-21T07:00:20.547808+0000","last_active":"2024-09-21T07:00:22.679904+0000","last_peered":"2024-09-21T07:00:22.679904+0000","last_clean":"2024-09-21T07:00:22.679904+0000","last_became_active":"2024-09-21T07:00:20.547399+0000","last_became_peered":"2024-09-21T07:00:20.547399+0000","last_unstale":"2024-09-21T07:00:22.679904+0000","last_undegraded":"2024-09-21T07:00:22.679904+0000","last_fullsized":"2024-09-21T07:00:22.679904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:31.765643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679015+0000","last_change":"2024-09-21T07:00:21.565188+0000","last_active":"2024-09-21T07:00:22.679015+0000","last_peered":"2024-09-21T07:00:22.679015+0000","last_clean":"2024-09-21T07:00:22.679015+0000","last_became_active":"2024-09-21T07:00:21.564511+0000","last_became_peered":"2024-09-21T07:00:21.564511+0000","last_unstale":"2024-09-21T07:00:22.679015+0000","last_undegraded":"2024-09-21T07:00:22.679015+0000","last_fullsized":"2024-09-21T07:00:22.679015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:11.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679575+0000","last_change":"2024-09-21T07:00:20.559723+0000","last_active":"2024-09-21T07:00:22.679575+0000","last_peered":"2024-09-21T07:00:22.679575+0000","last_clean":"2024-09-21T07:00:22.679575+0000","last_became_active":"2024-09-21T07:00:20.559395+0000","last_became_peered":"2024-09-21T07:00:20.559395+0000","last_unstale":"2024-09-21T07:00:22.679575+0000","last_undegraded":"2024-09-21T07:00:22.679575+0000","last_fullsized":"2024-09-21T07:00:22.679575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:11.305896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556037+0000","last_change":"2024-09-21T07:00:21.555249+0000","last_active":"2024-09-21T07:00:22.556037+0000","last_peered":"2024-09-21T07:00:22.556037+0000","last_clean":"2024-09-21T07:00:22.556037+0000","last_became_active":"2024-09-21T07:00:21.554923+0000","last_became_peered":"2024-09-21T07:00:21.554923+0000","last_unstale":"2024-09-21T07:00:22.556037+0000","last_undegraded":"2024-09-21T07:00:22.556037+0000","last_fullsized":"2024-09-21T07:00:22.556037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:35.387921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.677846+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:00:22.677846+0000","last_peered":"2024-09-21T07:00:22.677846+0000","last_clean":"2024-09-21T07:00:22.677846+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:00:22.677846+0000","last_undegraded":"2024-09-21T07:00:22.677846+0000","last_fullsized":"2024-09-21T07:00:22.677846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555751+0000","last_change":"2024-09-21T07:00:20.553179+0000","last_active":"2024-09-21T07:00:22.555751+0000","last_peered":"2024-09-21T07:00:22.555751+0000","last_clean":"2024-09-21T07:00:22.555751+0000","last_became_active":"2024-09-21T07:00:20.552827+0000","last_became_peered":"2024-09-21T07:00:20.552827+0000","last_unstale":"2024-09-21T07:00:22.555751+0000","last_undegraded":"2024-09-21T07:00:22.555751+0000","last_fullsized":"2024-09-21T07:00:22.555751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:08.559468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.560140+0000","last_change":"2024-09-21T07:00:21.555846+0000","last_active":"2024-09-21T07:00:21.560140+0000","last_peered":"2024-09-21T07:00:21.560140+0000","last_clean":"2024-09-21T07:00:21.560140+0000","last_became_active":"2024-09-21T07:00:21.555489+0000","last_became_peered":"2024-09-21T07:00:21.555489+0000","last_unstale":"2024-09-21T07:00:21.560140+0000","last_undegraded":"2024-09-21T07:00:21.560140+0000","last_fullsized":"2024-09-21T07:00:21.560140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:20.161600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555611+0000","last_change":"2024-09-21T07:00:20.548323+0000","last_active":"2024-09-21T07:00:22.555611+0000","last_peered":"2024-09-21T07:00:22.555611+0000","last_clean":"2024-09-21T07:00:22.555611+0000","last_became_active":"2024-09-21T07:00:20.547621+0000","last_became_peered":"2024-09-21T07:00:20.547621+0000","last_unstale":"2024-09-21T07:00:22.555611+0000","last_undegraded":"2024-09-21T07:00:22.555611+0000","last_fullsized":"2024-09-21T07:00:22.555611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:55.956461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679034+0000","last_change":"2024-09-21T07:00:21.551894+0000","last_active":"2024-09-21T07:00:22.679034+0000","last_peered":"2024-09-21T07:00:22.679034+0000","last_clean":"2024-09-21T07:00:22.679034+0000","last_became_active":"2024-09-21T07:00:21.551591+0000","last_became_peered":"2024-09-21T07:00:21.551591+0000","last_unstale":"2024-09-21T07:00:22.679034+0000","last_undegraded":"2024-09-21T07:00:22.679034+0000","last_fullsized":"2024-09-21T07:00:22.679034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:47.346271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678891+0000","last_change":"2024-09-21T07:00:20.547964+0000","last_active":"2024-09-21T07:00:22.678891+0000","last_peered":"2024-09-21T07:00:22.678891+0000","last_clean":"2024-09-21T07:00:22.678891+0000","last_became_active":"2024-09-21T07:00:20.547608+0000","last_became_peered":"2024-09-21T07:00:20.547608+0000","last_unstale":"2024-09-21T07:00:22.678891+0000","last_undegraded":"2024-09-21T07:00:22.678891+0000","last_fullsized":"2024-09-21T07:00:22.678891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:22.996288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680136+0000","last_change":"2024-09-21T07:00:21.561842+0000","last_active":"2024-09-21T07:00:22.680136+0000","last_peered":"2024-09-21T07:00:22.680136+0000","last_clean":"2024-09-21T07:00:22.680136+0000","last_became_active":"2024-09-21T07:00:21.561384+0000","last_became_peered":"2024-09-21T07:00:21.561384+0000","last_unstale":"2024-09-21T07:00:22.680136+0000","last_undegraded":"2024-09-21T07:00:22.680136+0000","last_fullsized":"2024-09-21T07:00:22.680136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:36.431383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555896+0000","last_change":"2024-09-21T07:00:20.549703+0000","last_active":"2024-09-21T07:00:22.555896+0000","last_peered":"2024-09-21T07:00:22.555896+0000","last_clean":"2024-09-21T07:00:22.555896+0000","last_became_active":"2024-09-21T07:00:20.549357+0000","last_became_peered":"2024-09-21T07:00:20.549357+0000","last_unstale":"2024-09-21T07:00:22.555896+0000","last_undegraded":"2024-09-21T07:00:22.555896+0000","last_fullsized":"2024-09-21T07:00:22.555896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:29.640468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678977+0000","last_change":"2024-09-21T07:00:21.567956+0000","last_active":"2024-09-21T07:00:22.678977+0000","last_peered":"2024-09-21T07:00:22.678977+0000","last_clean":"2024-09-21T07:00:22.678977+0000","last_became_active":"2024-09-21T07:00:21.567178+0000","last_became_peered":"2024-09-21T07:00:21.567178+0000","last_unstale":"2024-09-21T07:00:22.678977+0000","last_undegraded":"2024-09-21T07:00:22.678977+0000","last_fullsized":"2024-09-21T07:00:22.678977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:44.374303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679584+0000","last_change":"2024-09-21T07:00:20.549555+0000","last_active":"2024-09-21T07:00:22.679584+0000","last_peered":"2024-09-21T07:00:22.679584+0000","last_clean":"2024-09-21T07:00:22.679584+0000","last_became_active":"2024-09-21T07:00:20.549225+0000","last_became_peered":"2024-09-21T07:00:20.549225+0000","last_unstale":"2024-09-21T07:00:22.679584+0000","last_undegraded":"2024-09-21T07:00:22.679584+0000","last_fullsized":"2024-09-21T07:00:22.679584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:21.053297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559576+0000","last_change":"2024-09-21T07:00:21.557887+0000","last_active":"2024-09-21T07:00:22.559576+0000","last_peered":"2024-09-21T07:00:22.559576+0000","last_clean":"2024-09-21T07:00:22.559576+0000","last_became_active":"2024-09-21T07:00:21.557553+0000","last_became_peered":"2024-09-21T07:00:21.557553+0000","last_unstale":"2024-09-21T07:00:22.559576+0000","last_undegraded":"2024-09-21T07:00:22.559576+0000","last_fullsized":"2024-09-21T07:00:22.559576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:18.578209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556104+0000","last_change":"2024-09-21T07:00:20.543420+0000","last_active":"2024-09-21T07:00:22.556104+0000","last_peered":"2024-09-21T07:00:22.556104+0000","last_clean":"2024-09-21T07:00:22.556104+0000","last_became_active":"2024-09-21T07:00:20.542474+0000","last_became_peered":"2024-09-21T07:00:20.542474+0000","last_unstale":"2024-09-21T07:00:22.556104+0000","last_undegraded":"2024-09-21T07:00:22.556104+0000","last_fullsized":"2024-09-21T07:00:22.556104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:39.027438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679418+0000","last_change":"2024-09-21T07:00:21.559801+0000","last_active":"2024-09-21T07:00:22.679418+0000","last_peered":"2024-09-21T07:00:22.679418+0000","last_clean":"2024-09-21T07:00:22.679418+0000","last_became_active":"2024-09-21T07:00:21.559042+0000","last_became_peered":"2024-09-21T07:00:21.559042+0000","last_unstale":"2024-09-21T07:00:22.679418+0000","last_undegraded":"2024-09-21T07:00:22.679418+0000","last_fullsized":"2024-09-21T07:00:22.679418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:43.510885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.542399+0000","last_change":"2024-09-21T07:00:20.555344+0000","last_active":"2024-09-21T07:00:21.542399+0000","last_peered":"2024-09-21T07:00:21.542399+0000","last_clean":"2024-09-21T07:00:21.542399+0000","last_became_active":"2024-09-21T07:00:20.555062+0000","last_became_peered":"2024-09-21T07:00:20.555062+0000","last_unstale":"2024-09-21T07:00:21.542399+0000","last_undegraded":"2024-09-21T07:00:21.542399+0000","last_fullsized":"2024-09-21T07:00:21.542399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:48.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.559978+0000","last_change":"2024-09-21T07:00:21.555637+0000","last_active":"2024-09-21T07:00:21.559978+0000","last_peered":"2024-09-21T07:00:21.559978+0000","last_clean":"2024-09-21T07:00:21.559978+0000","last_became_active":"2024-09-21T07:00:21.554035+0000","last_became_peered":"2024-09-21T07:00:21.554035+0000","last_unstale":"2024-09-21T07:00:21.559978+0000","last_undegraded":"2024-09-21T07:00:21.559978+0000","last_fullsized":"2024-09-21T07:00:21.559978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:20:31.094122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556233+0000","last_change":"2024-09-21T07:00:20.557912+0000","last_active":"2024-09-21T07:00:22.556233+0000","last_peered":"2024-09-21T07:00:22.556233+0000","last_clean":"2024-09-21T07:00:22.556233+0000","last_became_active":"2024-09-21T07:00:20.557639+0000","last_became_peered":"2024-09-21T07:00:20.557639+0000","last_unstale":"2024-09-21T07:00:22.556233+0000","last_undegraded":"2024-09-21T07:00:22.556233+0000","last_fullsized":"2024-09-21T07:00:22.556233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:58.055286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.562149+0000","last_change":"2024-09-21T07:00:21.559146+0000","last_active":"2024-09-21T07:00:21.562149+0000","last_peered":"2024-09-21T07:00:21.562149+0000","last_clean":"2024-09-21T07:00:21.562149+0000","last_became_active":"2024-09-21T07:00:21.558843+0000","last_became_peered":"2024-09-21T07:00:21.558843+0000","last_unstale":"2024-09-21T07:00:21.562149+0000","last_undegraded":"2024-09-21T07:00:21.562149+0000","last_fullsized":"2024-09-21T07:00:21.562149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:35.286384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.677871+0000","last_change":"2024-09-21T07:00:20.554827+0000","last_active":"2024-09-21T07:00:22.677871+0000","last_peered":"2024-09-21T07:00:22.677871+0000","last_clean":"2024-09-21T07:00:22.677871+0000","last_became_active":"2024-09-21T07:00:20.554492+0000","last_became_peered":"2024-09-21T07:00:20.554492+0000","last_unstale":"2024-09-21T07:00:22.677871+0000","last_undegraded":"2024-09-21T07:00:22.677871+0000","last_fullsized":"2024-09-21T07:00:22.677871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:31.765643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555783+0000","last_change":"2024-09-21T07:00:21.544580+0000","last_active":"2024-09-21T07:00:22.555783+0000","last_peered":"2024-09-21T07:00:22.555783+0000","last_clean":"2024-09-21T07:00:22.555783+0000","last_became_active":"2024-09-21T07:00:21.544183+0000","last_became_peered":"2024-09-21T07:00:21.544183+0000","last_unstale":"2024-09-21T07:00:22.555783+0000","last_undegraded":"2024-09-21T07:00:22.555783+0000","last_fullsized":"2024-09-21T07:00:22.555783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:16.805232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.541794+0000","last_change":"2024-09-21T07:00:20.554018+0000","last_active":"2024-09-21T07:00:21.541794+0000","last_peered":"2024-09-21T07:00:21.541794+0000","last_clean":"2024-09-21T07:00:21.541794+0000","last_became_active":"2024-09-21T07:00:20.553671+0000","last_became_peered":"2024-09-21T07:00:20.553671+0000","last_unstale":"2024-09-21T07:00:21.541794+0000","last_undegraded":"2024-09-21T07:00:21.541794+0000","last_fullsized":"2024-09-21T07:00:21.541794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:05.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.560341+0000","last_change":"2024-09-21T07:00:21.557634+0000","last_active":"2024-09-21T07:00:21.560341+0000","last_peered":"2024-09-21T07:00:21.560341+0000","last_clean":"2024-09-21T07:00:21.560341+0000","last_became_active":"2024-09-21T07:00:21.557321+0000","last_became_peered":"2024-09-21T07:00:21.557321+0000","last_unstale":"2024-09-21T07:00:21.560341+0000","last_undegraded":"2024-09-21T07:00:21.560341+0000","last_fullsized":"2024-09-21T07:00:21.560341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:54.847595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679867+0000","last_change":"2024-09-21T07:00:20.549405+0000","last_active":"2024-09-21T07:00:22.679867+0000","last_peered":"2024-09-21T07:00:22.679867+0000","last_clean":"2024-09-21T07:00:22.679867+0000","last_became_active":"2024-09-21T07:00:20.549054+0000","last_became_peered":"2024-09-21T07:00:20.549054+0000","last_unstale":"2024-09-21T07:00:22.679867+0000","last_undegraded":"2024-09-21T07:00:22.679867+0000","last_fullsized":"2024-09-21T07:00:22.679867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:33.810421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678789+0000","last_change":"2024-09-21T07:00:21.558561+0000","last_active":"2024-09-21T07:00:22.678789+0000","last_peered":"2024-09-21T07:00:22.678789+0000","last_clean":"2024-09-21T07:00:22.678789+0000","last_became_active":"2024-09-21T07:00:21.558261+0000","last_became_peered":"2024-09-21T07:00:21.558261+0000","last_unstale":"2024-09-21T07:00:22.678789+0000","last_undegraded":"2024-09-21T07:00:22.678789+0000","last_fullsized":"2024-09-21T07:00:22.678789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:59.060831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555611+0000","last_change":"2024-09-21T07:00:20.553936+0000","last_active":"2024-09-21T07:00:22.555611+0000","last_peered":"2024-09-21T07:00:22.555611+0000","last_clean":"2024-09-21T07:00:22.555611+0000","last_became_active":"2024-09-21T07:00:20.553519+0000","last_became_peered":"2024-09-21T07:00:20.553519+0000","last_unstale":"2024-09-21T07:00:22.555611+0000","last_undegraded":"2024-09-21T07:00:22.555611+0000","last_fullsized":"2024-09-21T07:00:22.555611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:45.606392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555730+0000","last_change":"2024-09-21T07:00:21.561189+0000","last_active":"2024-09-21T07:00:22.555730+0000","last_peered":"2024-09-21T07:00:22.555730+0000","last_clean":"2024-09-21T07:00:22.555730+0000","last_became_active":"2024-09-21T07:00:21.560624+0000","last_became_peered":"2024-09-21T07:00:21.560624+0000","last_unstale":"2024-09-21T07:00:22.555730+0000","last_undegraded":"2024-09-21T07:00:22.555730+0000","last_fullsized":"2024-09-21T07:00:22.555730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:18.852711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556021+0000","last_change":"2024-09-21T07:00:21.562747+0000","last_active":"2024-09-21T07:00:22.556021+0000","last_peered":"2024-09-21T07:00:22.556021+0000","last_clean":"2024-09-21T07:00:22.556021+0000","last_became_active":"2024-09-21T07:00:21.561878+0000","last_became_peered":"2024-09-21T07:00:21.561878+0000","last_unstale":"2024-09-21T07:00:22.556021+0000","last_undegraded":"2024-09-21T07:00:22.556021+0000","last_fullsized":"2024-09-21T07:00:22.556021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:55.182037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679152+0000","last_change":"2024-09-21T07:00:20.544327+0000","last_active":"2024-09-21T07:00:22.679152+0000","last_peered":"2024-09-21T07:00:22.679152+0000","last_clean":"2024-09-21T07:00:22.679152+0000","last_became_active":"2024-09-21T07:00:20.542769+0000","last_became_peered":"2024-09-21T07:00:20.542769+0000","last_unstale":"2024-09-21T07:00:22.679152+0000","last_undegraded":"2024-09-21T07:00:22.679152+0000","last_fullsized":"2024-09-21T07:00:22.679152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:29.345084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678441+0000","last_change":"2024-09-21T07:00:21.569453+0000","last_active":"2024-09-21T07:00:22.678441+0000","last_peered":"2024-09-21T07:00:22.678441+0000","last_clean":"2024-09-21T07:00:22.678441+0000","last_became_active":"2024-09-21T07:00:21.569117+0000","last_became_peered":"2024-09-21T07:00:21.569117+0000","last_unstale":"2024-09-21T07:00:22.678441+0000","last_undegraded":"2024-09-21T07:00:22.678441+0000","last_fullsized":"2024-09-21T07:00:22.678441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:56.962006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679022+0000","last_change":"2024-09-21T07:00:20.547783+0000","last_active":"2024-09-21T07:00:22.679022+0000","last_peered":"2024-09-21T07:00:22.679022+0000","last_clean":"2024-09-21T07:00:22.679022+0000","last_became_active":"2024-09-21T07:00:20.547538+0000","last_became_peered":"2024-09-21T07:00:20.547538+0000","last_unstale":"2024-09-21T07:00:22.679022+0000","last_undegraded":"2024-09-21T07:00:22.679022+0000","last_fullsized":"2024-09-21T07:00:22.679022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.323272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680155+0000","last_change":"2024-09-21T07:00:21.557083+0000","last_active":"2024-09-21T07:00:22.680155+0000","last_peered":"2024-09-21T07:00:22.680155+0000","last_clean":"2024-09-21T07:00:22.680155+0000","last_became_active":"2024-09-21T07:00:21.556772+0000","last_became_peered":"2024-09-21T07:00:21.556772+0000","last_unstale":"2024-09-21T07:00:22.680155+0000","last_undegraded":"2024-09-21T07:00:22.680155+0000","last_fullsized":"2024-09-21T07:00:22.680155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:51.527888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680187+0000","last_change":"2024-09-21T07:00:20.543213+0000","last_active":"2024-09-21T07:00:22.680187+0000","last_peered":"2024-09-21T07:00:22.680187+0000","last_clean":"2024-09-21T07:00:22.680187+0000","last_became_active":"2024-09-21T07:00:20.542780+0000","last_became_peered":"2024-09-21T07:00:20.542780+0000","last_unstale":"2024-09-21T07:00:22.680187+0000","last_undegraded":"2024-09-21T07:00:22.680187+0000","last_fullsized":"2024-09-21T07:00:22.680187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.323272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680085+0000","last_change":"2024-09-21T07:00:21.566777+0000","last_active":"2024-09-21T07:00:22.680085+0000","last_peered":"2024-09-21T07:00:22.680085+0000","last_clean":"2024-09-21T07:00:22.680085+0000","last_became_active":"2024-09-21T07:00:21.566472+0000","last_became_peered":"2024-09-21T07:00:21.566472+0000","last_unstale":"2024-09-21T07:00:22.680085+0000","last_undegraded":"2024-09-21T07:00:22.680085+0000","last_fullsized":"2024-09-21T07:00:22.680085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:20.812379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T07:00:21.568036+0000","last_change":"2024-09-21T07:00:20.544364+0000","last_active":"2024-09-21T07:00:21.568036+0000","last_peered":"2024-09-21T07:00:21.568036+0000","last_clean":"2024-09-21T07:00:21.568036+0000","last_became_active":"2024-09-21T07:00:20.543152+0000","last_became_peered":"2024-09-21T07:00:20.543152+0000","last_unstale":"2024-09-21T07:00:21.568036+0000","last_undegraded":"2024-09-21T07:00:21.568036+0000","last_fullsized":"2024-09-21T07:00:21.568036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:24.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":823296,"data_stored":667024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":77146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":78176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":72548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:00:30.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:00:30.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.265+0000 7f5cab19d640 1 -- 172.21.15.63:0/302849438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ca40d27f0 msgr2=0x7f5ca40d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:30.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.265+0000 7f5cab19d640 1 --2- 172.21.15.63:0/302849438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ca40d27f0 0x7f5ca40d2c00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5ca41628f0 tx=0x7f5c9802a4a0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.265+0000 7f5cab19d640 1 -- 172.21.15.63:0/302849438 shutdown_connections 2024-09-21T07:00:30.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.265+0000 7f5cab19d640 1 --2- 172.21.15.63:0/302849438 >> v2:172.21.15.71:3300/0 conn(0x7f5ca40d0bf0 0x7f5ca40d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.265+0000 7f5cab19d640 1 --2- 172.21.15.63:0/302849438 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ca40d27f0 0x7f5ca40d2c00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.265+0000 7f5cab19d640 1 -- 172.21.15.63:0/302849438 >> 172.21.15.63:0/302849438 conn(0x7f5ca406dde0 msgr2=0x7f5ca406e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:30.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.265+0000 7f5cab19d640 1 -- 172.21.15.63:0/302849438 shutdown_connections 2024-09-21T07:00:30.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.265+0000 7f5cab19d640 1 -- 172.21.15.63:0/302849438 wait complete. 2024-09-21T07:00:30.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.267+0000 7f5cab19d640 1 Processor -- start 2024-09-21T07:00:30.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.267+0000 7f5cab19d640 1 -- start start 2024-09-21T07:00:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5cab19d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ca40cfd70 0x7f5ca40cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5cab19d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca40d0bf0 0x7f5ca41eb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5cab19d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ca40d27f0 0x7f5ca40ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5cab19d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca415eb10 con 0x7f5ca40d27f0 2024-09-21T07:00:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5cab19d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca415e990 con 0x7f5ca40d0bf0 2024-09-21T07:00:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5cab19d640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5ca415ec90 con 0x7f5ca40cfd70 2024-09-21T07:00:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5caa99c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ca40d27f0 0x7f5ca40ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5caa99c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ca40d27f0 0x7f5ca40ca920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36688/0 (socket says 172.21.15.63:36688) 2024-09-21T07:00:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5caa99c640 1 -- 172.21.15.63:0/3051508594 learned_addr learned my addr 172.21.15.63:0/3051508594 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5ca999a640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca40d0bf0 0x7f5ca41eb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5caa19b640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ca40cfd70 0x7f5ca40cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:30.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5caa99c640 1 -- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ca40cfd70 msgr2=0x7f5ca40cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5caa99c640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ca40cfd70 0x7f5ca40cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5caa99c640 1 -- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca40d0bf0 msgr2=0x7f5ca41eb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5caa99c640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca40d0bf0 0x7f5ca41eb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5caa99c640 1 -- 172.21.15.63:0/3051508594 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca4149440 con 0x7f5ca40d27f0 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5ca999a640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca40d0bf0 0x7f5ca41eb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5caa19b640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ca40cfd70 0x7f5ca40cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5caa99c640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ca40d27f0 0x7f5ca40ca920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400da90 tx=0x7f5c9400df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5ca2ffd640 1 -- 172.21.15.63:0/3051508594 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94017070 con 0x7f5ca40d27f0 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5ca2ffd640 1 -- 172.21.15.63:0/3051508594 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c94003970 con 0x7f5ca40d27f0 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5cab19d640 1 -- 172.21.15.63:0/3051508594 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca4149720 con 0x7f5ca40d27f0 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.269+0000 7f5ca2ffd640 1 -- 172.21.15.63:0/3051508594 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94003dc0 con 0x7f5ca40d27f0 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.270+0000 7f5cab19d640 1 -- 172.21.15.63:0/3051508594 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca4149ce0 con 0x7f5ca40d27f0 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.271+0000 7f5cab19d640 1 -- 172.21.15.63:0/3051508594 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca40d1000 con 0x7f5ca40d27f0 2024-09-21T07:00:30.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.271+0000 7f5ca2ffd640 1 -- 172.21.15.63:0/3051508594 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c94003f60 con 0x7f5ca40d27f0 2024-09-21T07:00:30.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.272+0000 7f5ca2ffd640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5c90078b90 0x7f5c9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:30.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.272+0000 7f5ca2ffd640 1 -- 172.21.15.63:0/3051508594 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5c9409b130 con 0x7f5ca40d27f0 2024-09-21T07:00:30.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.272+0000 7f5caa19b640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5c90078b90 0x7f5c9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:30.275 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.273+0000 7f5caa19b640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5c90078b90 0x7f5c9007b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c000f60 tx=0x7f5c9c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:30.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.276+0000 7f5ca2ffd640 1 -- 172.21.15.63:0/3051508594 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5c94063600 con 0x7f5ca40d27f0 2024-09-21T07:00:30.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.458+0000 7f5cab19d640 1 -- 172.21.15.63:0/3051508594 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ca415c0f0 con 0x7f5c90078b90 2024-09-21T07:00:30.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.463+0000 7f5ca2ffd640 1 -- 172.21.15.63:0/3051508594 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251921 (secure 0 0 0) 0x7f5c9c0013a0 con 0x7f5c90078b90 2024-09-21T07:00:30.467 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:30.469 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:00:30.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.466+0000 7f5cab19d640 1 -- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5c90078b90 msgr2=0x7f5c9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:30.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.466+0000 7f5cab19d640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5c90078b90 0x7f5c9007b0a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c000f60 tx=0x7f5c9c009040 comp rx=0 tx=0).stop 2024-09-21T07:00:30.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.466+0000 7f5cab19d640 1 -- 172.21.15.63:0/3051508594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ca40d27f0 msgr2=0x7f5ca40ca920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:30.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.466+0000 7f5cab19d640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ca40d27f0 0x7f5ca40ca920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400da90 tx=0x7f5c9400df50 comp rx=0 tx=0).stop 2024-09-21T07:00:30.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.466+0000 7f5cab19d640 1 -- 172.21.15.63:0/3051508594 shutdown_connections 2024-09-21T07:00:30.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.466+0000 7f5cab19d640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5c90078b90 0x7f5c9007b0a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.466+0000 7f5cab19d640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ca40d27f0 0x7f5ca40ca920 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.466+0000 7f5cab19d640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5ca40d0bf0 0x7f5ca41eb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.466+0000 7f5cab19d640 1 --2- 172.21.15.63:0/3051508594 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5ca40cfd70 0x7f5ca40cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.466+0000 7f5cab19d640 1 -- 172.21.15.63:0/3051508594 >> 172.21.15.63:0/3051508594 conn(0x7f5ca406dde0 msgr2=0x7f5ca4075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:30.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.466+0000 7f5cab19d640 1 -- 172.21.15.63:0/3051508594 shutdown_connections 2024-09-21T07:00:30.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.466+0000 7f5cab19d640 1 -- 172.21.15.63:0/3051508594 wait complete. 2024-09-21T07:00:30.479 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-21T07:00:28.598875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219224,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755496,"statfs":{"total":773094113280,"available":772869627904,"internally_reserved":0,"allocated":3022848,"data_stored":1798068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002237"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679263+0000","last_change":"2024-09-21T07:00:21.563189+0000","last_active":"2024-09-21T07:00:22.679263+0000","last_peered":"2024-09-21T07:00:22.679263+0000","last_clean":"2024-09-21T07:00:22.679263+0000","last_became_active":"2024-09-21T07:00:21.562870+0000","last_became_peered":"2024-09-21T07:00:21.562870+0000","last_unstale":"2024-09-21T07:00:22.679263+0000","last_undegraded":"2024-09-21T07:00:22.679263+0000","last_fullsized":"2024-09-21T07:00:22.679263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:10.283749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679665+0000","last_change":"2024-09-21T07:00:21.562578+0000","last_active":"2024-09-21T07:00:22.679665+0000","last_peered":"2024-09-21T07:00:22.679665+0000","last_clean":"2024-09-21T07:00:22.679665+0000","last_became_active":"2024-09-21T07:00:21.560210+0000","last_became_peered":"2024-09-21T07:00:21.560210+0000","last_unstale":"2024-09-21T07:00:22.679665+0000","last_undegraded":"2024-09-21T07:00:22.679665+0000","last_fullsized":"2024-09-21T07:00:22.679665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:21.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679819+0000","last_change":"2024-09-21T07:00:21.558740+0000","last_active":"2024-09-21T07:00:22.679819+0000","last_peered":"2024-09-21T07:00:22.679819+0000","last_clean":"2024-09-21T07:00:22.679819+0000","last_became_active":"2024-09-21T07:00:21.558262+0000","last_became_peered":"2024-09-21T07:00:21.558262+0000","last_unstale":"2024-09-21T07:00:22.679819+0000","last_undegraded":"2024-09-21T07:00:22.679819+0000","last_fullsized":"2024-09-21T07:00:22.679819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:13.795076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559508+0000","last_change":"2024-09-21T07:00:21.572137+0000","last_active":"2024-09-21T07:00:22.559508+0000","last_peered":"2024-09-21T07:00:22.559508+0000","last_clean":"2024-09-21T07:00:22.559508+0000","last_became_active":"2024-09-21T07:00:21.571794+0000","last_became_peered":"2024-09-21T07:00:21.571794+0000","last_unstale":"2024-09-21T07:00:22.559508+0000","last_undegraded":"2024-09-21T07:00:22.559508+0000","last_fullsized":"2024-09-21T07:00:22.559508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:30.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679078+0000","last_change":"2024-09-21T07:00:21.564124+0000","last_active":"2024-09-21T07:00:22.679078+0000","last_peered":"2024-09-21T07:00:22.679078+0000","last_clean":"2024-09-21T07:00:22.679078+0000","last_became_active":"2024-09-21T07:00:21.563782+0000","last_became_peered":"2024-09-21T07:00:21.563782+0000","last_unstale":"2024-09-21T07:00:22.679078+0000","last_undegraded":"2024-09-21T07:00:22.679078+0000","last_fullsized":"2024-09-21T07:00:22.679078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:56.959773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559317+0000","last_change":"2024-09-21T07:00:21.570373+0000","last_active":"2024-09-21T07:00:22.559317+0000","last_peered":"2024-09-21T07:00:22.559317+0000","last_clean":"2024-09-21T07:00:22.559317+0000","last_became_active":"2024-09-21T07:00:21.570032+0000","last_became_peered":"2024-09-21T07:00:21.570032+0000","last_unstale":"2024-09-21T07:00:22.559317+0000","last_undegraded":"2024-09-21T07:00:22.559317+0000","last_fullsized":"2024-09-21T07:00:22.559317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:46.611937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678752+0000","last_change":"2024-09-21T07:00:21.564072+0000","last_active":"2024-09-21T07:00:22.678752+0000","last_peered":"2024-09-21T07:00:22.678752+0000","last_clean":"2024-09-21T07:00:22.678752+0000","last_became_active":"2024-09-21T07:00:21.563740+0000","last_became_peered":"2024-09-21T07:00:21.563740+0000","last_unstale":"2024-09-21T07:00:22.678752+0000","last_undegraded":"2024-09-21T07:00:22.678752+0000","last_fullsized":"2024-09-21T07:00:22.678752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:43.306215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679196+0000","last_change":"2024-09-21T07:00:21.571903+0000","last_active":"2024-09-21T07:00:22.679196+0000","last_peered":"2024-09-21T07:00:22.679196+0000","last_clean":"2024-09-21T07:00:22.679196+0000","last_became_active":"2024-09-21T07:00:21.571504+0000","last_became_peered":"2024-09-21T07:00:21.571504+0000","last_unstale":"2024-09-21T07:00:22.679196+0000","last_undegraded":"2024-09-21T07:00:22.679196+0000","last_fullsized":"2024-09-21T07:00:22.679196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:12.175330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678344+0000","last_change":"2024-09-21T07:00:21.560654+0000","last_active":"2024-09-21T07:00:22.678344+0000","last_peered":"2024-09-21T07:00:22.678344+0000","last_clean":"2024-09-21T07:00:22.678344+0000","last_became_active":"2024-09-21T07:00:21.560359+0000","last_became_peered":"2024-09-21T07:00:21.560359+0000","last_unstale":"2024-09-21T07:00:22.678344+0000","last_undegraded":"2024-09-21T07:00:22.678344+0000","last_fullsized":"2024-09-21T07:00:22.678344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:18.578209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678878+0000","last_change":"2024-09-21T07:00:21.567336+0000","last_active":"2024-09-21T07:00:22.678878+0000","last_peered":"2024-09-21T07:00:22.678878+0000","last_clean":"2024-09-21T07:00:22.678878+0000","last_became_active":"2024-09-21T07:00:21.566797+0000","last_became_peered":"2024-09-21T07:00:21.566797+0000","last_unstale":"2024-09-21T07:00:22.678878+0000","last_undegraded":"2024-09-21T07:00:22.678878+0000","last_fullsized":"2024-09-21T07:00:22.678878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:40.090374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678934+0000","last_change":"2024-09-21T07:00:21.563225+0000","last_active":"2024-09-21T07:00:22.678934+0000","last_peered":"2024-09-21T07:00:22.678934+0000","last_clean":"2024-09-21T07:00:22.678934+0000","last_became_active":"2024-09-21T07:00:21.560365+0000","last_became_peered":"2024-09-21T07:00:21.560365+0000","last_unstale":"2024-09-21T07:00:22.678934+0000","last_undegraded":"2024-09-21T07:00:22.678934+0000","last_fullsized":"2024-09-21T07:00:22.678934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:39.852924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678783+0000","last_change":"2024-09-21T07:00:21.562837+0000","last_active":"2024-09-21T07:00:22.678783+0000","last_peered":"2024-09-21T07:00:22.678783+0000","last_clean":"2024-09-21T07:00:22.678783+0000","last_became_active":"2024-09-21T07:00:21.560315+0000","last_became_peered":"2024-09-21T07:00:21.560315+0000","last_unstale":"2024-09-21T07:00:22.678783+0000","last_undegraded":"2024-09-21T07:00:22.678783+0000","last_fullsized":"2024-09-21T07:00:22.678783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:34:47.707070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678905+0000","last_change":"2024-09-21T07:00:21.562487+0000","last_active":"2024-09-21T07:00:22.678905+0000","last_peered":"2024-09-21T07:00:22.678905+0000","last_clean":"2024-09-21T07:00:22.678905+0000","last_became_active":"2024-09-21T07:00:21.562191+0000","last_became_peered":"2024-09-21T07:00:21.562191+0000","last_unstale":"2024-09-21T07:00:22.678905+0000","last_undegraded":"2024-09-21T07:00:22.678905+0000","last_fullsized":"2024-09-21T07:00:22.678905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:56.671345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678874+0000","last_change":"2024-09-21T07:00:21.553283+0000","last_active":"2024-09-21T07:00:22.678874+0000","last_peered":"2024-09-21T07:00:22.678874+0000","last_clean":"2024-09-21T07:00:22.678874+0000","last_became_active":"2024-09-21T07:00:21.552964+0000","last_became_peered":"2024-09-21T07:00:21.552964+0000","last_unstale":"2024-09-21T07:00:22.678874+0000","last_undegraded":"2024-09-21T07:00:22.678874+0000","last_fullsized":"2024-09-21T07:00:22.678874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:45.103534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678984+0000","last_change":"2024-09-21T07:00:21.571890+0000","last_active":"2024-09-21T07:00:22.678984+0000","last_peered":"2024-09-21T07:00:22.678984+0000","last_clean":"2024-09-21T07:00:22.678984+0000","last_became_active":"2024-09-21T07:00:21.571519+0000","last_became_peered":"2024-09-21T07:00:21.571519+0000","last_unstale":"2024-09-21T07:00:22.678984+0000","last_undegraded":"2024-09-21T07:00:22.678984+0000","last_fullsized":"2024-09-21T07:00:22.678984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:02.733307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555427+0000","last_change":"2024-09-21T07:00:21.552279+0000","last_active":"2024-09-21T07:00:22.555427+0000","last_peered":"2024-09-21T07:00:22.555427+0000","last_clean":"2024-09-21T07:00:22.555427+0000","last_became_active":"2024-09-21T07:00:21.551937+0000","last_became_peered":"2024-09-21T07:00:21.551937+0000","last_unstale":"2024-09-21T07:00:22.555427+0000","last_undegraded":"2024-09-21T07:00:22.555427+0000","last_fullsized":"2024-09-21T07:00:22.555427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:03.253724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556346+0000","last_change":"2024-09-21T07:00:21.565756+0000","last_active":"2024-09-21T07:00:22.556346+0000","last_peered":"2024-09-21T07:00:22.556346+0000","last_clean":"2024-09-21T07:00:22.556346+0000","last_became_active":"2024-09-21T07:00:21.565449+0000","last_became_peered":"2024-09-21T07:00:21.565449+0000","last_unstale":"2024-09-21T07:00:22.556346+0000","last_undegraded":"2024-09-21T07:00:22.556346+0000","last_fullsized":"2024-09-21T07:00:22.556346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:15.636322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679671+0000","last_change":"2024-09-21T07:00:21.565470+0000","last_active":"2024-09-21T07:00:22.679671+0000","last_peered":"2024-09-21T07:00:22.679671+0000","last_clean":"2024-09-21T07:00:22.679671+0000","last_became_active":"2024-09-21T07:00:21.565119+0000","last_became_peered":"2024-09-21T07:00:21.565119+0000","last_unstale":"2024-09-21T07:00:22.679671+0000","last_undegraded":"2024-09-21T07:00:22.679671+0000","last_fullsized":"2024-09-21T07:00:22.679671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:30.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556259+0000","last_change":"2024-09-21T07:00:21.551138+0000","last_active":"2024-09-21T07:00:22.556259+0000","last_peered":"2024-09-21T07:00:22.556259+0000","last_clean":"2024-09-21T07:00:22.556259+0000","last_became_active":"2024-09-21T07:00:21.550659+0000","last_became_peered":"2024-09-21T07:00:21.550659+0000","last_unstale":"2024-09-21T07:00:22.556259+0000","last_undegraded":"2024-09-21T07:00:22.556259+0000","last_fullsized":"2024-09-21T07:00:22.556259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:40.906741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679056+0000","last_change":"2024-09-21T07:00:21.563105+0000","last_active":"2024-09-21T07:00:22.679056+0000","last_peered":"2024-09-21T07:00:22.679056+0000","last_clean":"2024-09-21T07:00:22.679056+0000","last_became_active":"2024-09-21T07:00:21.559949+0000","last_became_peered":"2024-09-21T07:00:21.559949+0000","last_unstale":"2024-09-21T07:00:22.679056+0000","last_undegraded":"2024-09-21T07:00:22.679056+0000","last_fullsized":"2024-09-21T07:00:22.679056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:02.486805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560203+0000","last_change":"2024-09-21T07:00:21.558126+0000","last_active":"2024-09-21T07:00:22.560203+0000","last_peered":"2024-09-21T07:00:22.560203+0000","last_clean":"2024-09-21T07:00:22.560203+0000","last_became_active":"2024-09-21T07:00:21.557784+0000","last_became_peered":"2024-09-21T07:00:21.557784+0000","last_unstale":"2024-09-21T07:00:22.560203+0000","last_undegraded":"2024-09-21T07:00:22.560203+0000","last_fullsized":"2024-09-21T07:00:22.560203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:08.303864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678141+0000","last_change":"2024-09-21T07:00:21.564458+0000","last_active":"2024-09-21T07:00:22.678141+0000","last_peered":"2024-09-21T07:00:22.678141+0000","last_clean":"2024-09-21T07:00:22.678141+0000","last_became_active":"2024-09-21T07:00:21.564109+0000","last_became_peered":"2024-09-21T07:00:21.564109+0000","last_unstale":"2024-09-21T07:00:22.678141+0000","last_undegraded":"2024-09-21T07:00:22.678141+0000","last_fullsized":"2024-09-21T07:00:22.678141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:59.060831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679386+0000","last_change":"2024-09-21T07:00:21.565436+0000","last_active":"2024-09-21T07:00:22.679386+0000","last_peered":"2024-09-21T07:00:22.679386+0000","last_clean":"2024-09-21T07:00:22.679386+0000","last_became_active":"2024-09-21T07:00:21.565144+0000","last_became_peered":"2024-09-21T07:00:21.565144+0000","last_unstale":"2024-09-21T07:00:22.679386+0000","last_undegraded":"2024-09-21T07:00:22.679386+0000","last_fullsized":"2024-09-21T07:00:22.679386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:22.045462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555426+0000","last_change":"2024-09-21T07:00:21.561626+0000","last_active":"2024-09-21T07:00:22.555426+0000","last_peered":"2024-09-21T07:00:22.555426+0000","last_clean":"2024-09-21T07:00:22.555426+0000","last_became_active":"2024-09-21T07:00:21.561134+0000","last_became_peered":"2024-09-21T07:00:21.561134+0000","last_unstale":"2024-09-21T07:00:22.555426+0000","last_undegraded":"2024-09-21T07:00:22.555426+0000","last_fullsized":"2024-09-21T07:00:22.555426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:56.959773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679918+0000","last_change":"2024-09-21T07:00:21.557981+0000","last_active":"2024-09-21T07:00:22.679918+0000","last_peered":"2024-09-21T07:00:22.679918+0000","last_clean":"2024-09-21T07:00:22.679918+0000","last_became_active":"2024-09-21T07:00:21.557675+0000","last_became_peered":"2024-09-21T07:00:21.557675+0000","last_unstale":"2024-09-21T07:00:22.679918+0000","last_undegraded":"2024-09-21T07:00:22.679918+0000","last_fullsized":"2024-09-21T07:00:22.679918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:49.917053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559596+0000","last_change":"2024-09-21T07:00:21.566434+0000","last_active":"2024-09-21T07:00:22.559596+0000","last_peered":"2024-09-21T07:00:22.559596+0000","last_clean":"2024-09-21T07:00:22.559596+0000","last_became_active":"2024-09-21T07:00:21.566140+0000","last_became_peered":"2024-09-21T07:00:21.566140+0000","last_unstale":"2024-09-21T07:00:22.559596+0000","last_undegraded":"2024-09-21T07:00:22.559596+0000","last_fullsized":"2024-09-21T07:00:22.559596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:56.962006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680033+0000","last_change":"2024-09-21T07:00:21.554587+0000","last_active":"2024-09-21T07:00:22.680033+0000","last_peered":"2024-09-21T07:00:22.680033+0000","last_clean":"2024-09-21T07:00:22.680033+0000","last_became_active":"2024-09-21T07:00:21.553603+0000","last_became_peered":"2024-09-21T07:00:21.553603+0000","last_unstale":"2024-09-21T07:00:22.680033+0000","last_undegraded":"2024-09-21T07:00:22.680033+0000","last_fullsized":"2024-09-21T07:00:22.680033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:09.948521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679387+0000","last_change":"2024-09-21T07:00:21.563521+0000","last_active":"2024-09-21T07:00:22.679387+0000","last_peered":"2024-09-21T07:00:22.679387+0000","last_clean":"2024-09-21T07:00:22.679387+0000","last_became_active":"2024-09-21T07:00:21.563231+0000","last_became_peered":"2024-09-21T07:00:21.563231+0000","last_unstale":"2024-09-21T07:00:22.679387+0000","last_undegraded":"2024-09-21T07:00:22.679387+0000","last_fullsized":"2024-09-21T07:00:22.679387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:09.410925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680038+0000","last_change":"2024-09-21T07:00:21.562180+0000","last_active":"2024-09-21T07:00:22.680038+0000","last_peered":"2024-09-21T07:00:22.680038+0000","last_clean":"2024-09-21T07:00:22.680038+0000","last_became_active":"2024-09-21T07:00:21.561470+0000","last_became_peered":"2024-09-21T07:00:21.561470+0000","last_unstale":"2024-09-21T07:00:22.680038+0000","last_undegraded":"2024-09-21T07:00:22.680038+0000","last_fullsized":"2024-09-21T07:00:22.680038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:37.907222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555639+0000","last_change":"2024-09-21T07:00:21.556962+0000","last_active":"2024-09-21T07:00:22.555639+0000","last_peered":"2024-09-21T07:00:22.555639+0000","last_clean":"2024-09-21T07:00:22.555639+0000","last_became_active":"2024-09-21T07:00:21.556476+0000","last_became_peered":"2024-09-21T07:00:21.556476+0000","last_unstale":"2024-09-21T07:00:22.555639+0000","last_undegraded":"2024-09-21T07:00:22.555639+0000","last_fullsized":"2024-09-21T07:00:22.555639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:45.749731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678807+0000","last_change":"2024-09-21T07:00:21.556889+0000","last_active":"2024-09-21T07:00:22.678807+0000","last_peered":"2024-09-21T07:00:22.678807+0000","last_clean":"2024-09-21T07:00:22.678807+0000","last_became_active":"2024-09-21T07:00:21.556591+0000","last_became_peered":"2024-09-21T07:00:21.556591+0000","last_unstale":"2024-09-21T07:00:22.678807+0000","last_undegraded":"2024-09-21T07:00:22.678807+0000","last_fullsized":"2024-09-21T07:00:22.678807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:46.611937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559221+0000","last_change":"2024-09-21T07:00:21.553852+0000","last_active":"2024-09-21T07:00:22.559221+0000","last_peered":"2024-09-21T07:00:22.559221+0000","last_clean":"2024-09-21T07:00:22.559221+0000","last_became_active":"2024-09-21T07:00:21.553416+0000","last_became_peered":"2024-09-21T07:00:21.553416+0000","last_unstale":"2024-09-21T07:00:22.559221+0000","last_undegraded":"2024-09-21T07:00:22.559221+0000","last_fullsized":"2024-09-21T07:00:22.559221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:59.060831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678185+0000","last_change":"2024-09-21T07:00:21.555826+0000","last_active":"2024-09-21T07:00:22.678185+0000","last_peered":"2024-09-21T07:00:22.678185+0000","last_clean":"2024-09-21T07:00:22.678185+0000","last_became_active":"2024-09-21T07:00:21.555430+0000","last_became_peered":"2024-09-21T07:00:21.555430+0000","last_unstale":"2024-09-21T07:00:22.678185+0000","last_undegraded":"2024-09-21T07:00:22.678185+0000","last_fullsized":"2024-09-21T07:00:22.678185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:46.611937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679918+0000","last_change":"2024-09-21T07:00:20.549521+0000","last_active":"2024-09-21T07:00:22.679918+0000","last_peered":"2024-09-21T07:00:22.679918+0000","last_clean":"2024-09-21T07:00:22.679918+0000","last_became_active":"2024-09-21T07:00:20.549184+0000","last_became_peered":"2024-09-21T07:00:20.549184+0000","last_unstale":"2024-09-21T07:00:22.679918+0000","last_undegraded":"2024-09-21T07:00:22.679918+0000","last_fullsized":"2024-09-21T07:00:22.679918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:18.707436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559636+0000","last_change":"2024-09-21T07:00:21.565217+0000","last_active":"2024-09-21T07:00:22.559636+0000","last_peered":"2024-09-21T07:00:22.559636+0000","last_clean":"2024-09-21T07:00:22.559636+0000","last_became_active":"2024-09-21T07:00:21.564900+0000","last_became_peered":"2024-09-21T07:00:21.564900+0000","last_unstale":"2024-09-21T07:00:22.559636+0000","last_undegraded":"2024-09-21T07:00:22.559636+0000","last_fullsized":"2024-09-21T07:00:22.559636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:54.612942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555720+0000","last_change":"2024-09-21T07:00:20.550510+0000","last_active":"2024-09-21T07:00:22.555720+0000","last_peered":"2024-09-21T07:00:22.555720+0000","last_clean":"2024-09-21T07:00:22.555720+0000","last_became_active":"2024-09-21T07:00:20.550109+0000","last_became_peered":"2024-09-21T07:00:20.550109+0000","last_unstale":"2024-09-21T07:00:22.555720+0000","last_undegraded":"2024-09-21T07:00:22.555720+0000","last_fullsized":"2024-09-21T07:00:22.555720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:17.572663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679063+0000","last_change":"2024-09-21T07:00:20.559604+0000","last_active":"2024-09-21T07:00:22.679063+0000","last_peered":"2024-09-21T07:00:22.679063+0000","last_clean":"2024-09-21T07:00:22.679063+0000","last_became_active":"2024-09-21T07:00:20.559313+0000","last_became_peered":"2024-09-21T07:00:20.559313+0000","last_unstale":"2024-09-21T07:00:22.679063+0000","last_undegraded":"2024-09-21T07:00:22.679063+0000","last_fullsized":"2024-09-21T07:00:22.679063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:35.935572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679467+0000","last_change":"2024-09-21T07:00:21.555824+0000","last_active":"2024-09-21T07:00:22.679467+0000","last_peered":"2024-09-21T07:00:22.679467+0000","last_clean":"2024-09-21T07:00:22.679467+0000","last_became_active":"2024-09-21T07:00:21.554777+0000","last_became_peered":"2024-09-21T07:00:21.554777+0000","last_unstale":"2024-09-21T07:00:22.679467+0000","last_undegraded":"2024-09-21T07:00:22.679467+0000","last_fullsized":"2024-09-21T07:00:22.679467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:58.019313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555503+0000","last_change":"2024-09-21T07:00:20.547960+0000","last_active":"2024-09-21T07:00:22.555503+0000","last_peered":"2024-09-21T07:00:22.555503+0000","last_clean":"2024-09-21T07:00:22.555503+0000","last_became_active":"2024-09-21T07:00:20.546833+0000","last_became_peered":"2024-09-21T07:00:20.546833+0000","last_unstale":"2024-09-21T07:00:22.555503+0000","last_undegraded":"2024-09-21T07:00:22.555503+0000","last_fullsized":"2024-09-21T07:00:22.555503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:37.528194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559865+0000","last_change":"2024-09-21T07:00:21.563091+0000","last_active":"2024-09-21T07:00:22.559865+0000","last_peered":"2024-09-21T07:00:22.559865+0000","last_clean":"2024-09-21T07:00:22.559865+0000","last_became_active":"2024-09-21T07:00:21.562811+0000","last_became_peered":"2024-09-21T07:00:21.562811+0000","last_unstale":"2024-09-21T07:00:22.559865+0000","last_undegraded":"2024-09-21T07:00:22.559865+0000","last_fullsized":"2024-09-21T07:00:22.559865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:49.171420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678235+0000","last_change":"2024-09-21T07:00:20.545659+0000","last_active":"2024-09-21T07:00:22.678235+0000","last_peered":"2024-09-21T07:00:22.678235+0000","last_clean":"2024-09-21T07:00:22.678235+0000","last_became_active":"2024-09-21T07:00:20.545366+0000","last_became_peered":"2024-09-21T07:00:20.545366+0000","last_unstale":"2024-09-21T07:00:22.678235+0000","last_undegraded":"2024-09-21T07:00:22.678235+0000","last_fullsized":"2024-09-21T07:00:22.678235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:22.996288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559756+0000","last_change":"2024-09-21T07:00:21.565942+0000","last_active":"2024-09-21T07:00:22.559756+0000","last_peered":"2024-09-21T07:00:22.559756+0000","last_clean":"2024-09-21T07:00:22.559756+0000","last_became_active":"2024-09-21T07:00:21.565056+0000","last_became_peered":"2024-09-21T07:00:21.565056+0000","last_unstale":"2024-09-21T07:00:22.559756+0000","last_undegraded":"2024-09-21T07:00:22.559756+0000","last_fullsized":"2024-09-21T07:00:22.559756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:09.565013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678861+0000","last_change":"2024-09-21T07:00:20.554660+0000","last_active":"2024-09-21T07:00:22.678861+0000","last_peered":"2024-09-21T07:00:22.678861+0000","last_clean":"2024-09-21T07:00:22.678861+0000","last_became_active":"2024-09-21T07:00:20.554334+0000","last_became_peered":"2024-09-21T07:00:20.554334+0000","last_unstale":"2024-09-21T07:00:22.678861+0000","last_undegraded":"2024-09-21T07:00:22.678861+0000","last_fullsized":"2024-09-21T07:00:22.678861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:45.606392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680202+0000","last_change":"2024-09-21T07:00:21.555156+0000","last_active":"2024-09-21T07:00:22.680202+0000","last_peered":"2024-09-21T07:00:22.680202+0000","last_clean":"2024-09-21T07:00:22.680202+0000","last_became_active":"2024-09-21T07:00:21.554579+0000","last_became_peered":"2024-09-21T07:00:21.554579+0000","last_unstale":"2024-09-21T07:00:22.680202+0000","last_undegraded":"2024-09-21T07:00:22.680202+0000","last_fullsized":"2024-09-21T07:00:22.680202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:07.081855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679218+0000","last_change":"2024-09-21T07:00:20.551878+0000","last_active":"2024-09-21T07:00:22.679218+0000","last_peered":"2024-09-21T07:00:22.679218+0000","last_clean":"2024-09-21T07:00:22.679218+0000","last_became_active":"2024-09-21T07:00:20.551510+0000","last_became_peered":"2024-09-21T07:00:20.551510+0000","last_unstale":"2024-09-21T07:00:22.679218+0000","last_undegraded":"2024-09-21T07:00:22.679218+0000","last_fullsized":"2024-09-21T07:00:22.679218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:21.053297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555616+0000","last_change":"2024-09-21T07:00:21.557553+0000","last_active":"2024-09-21T07:00:22.555616+0000","last_peered":"2024-09-21T07:00:22.555616+0000","last_clean":"2024-09-21T07:00:22.555616+0000","last_became_active":"2024-09-21T07:00:21.557241+0000","last_became_peered":"2024-09-21T07:00:21.557241+0000","last_unstale":"2024-09-21T07:00:22.555616+0000","last_undegraded":"2024-09-21T07:00:22.555616+0000","last_fullsized":"2024-09-21T07:00:22.555616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:55.968830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559402+0000","last_change":"2024-09-21T07:00:20.556459+0000","last_active":"2024-09-21T07:00:22.559402+0000","last_peered":"2024-09-21T07:00:22.559402+0000","last_clean":"2024-09-21T07:00:22.559402+0000","last_became_active":"2024-09-21T07:00:20.556107+0000","last_became_peered":"2024-09-21T07:00:20.556107+0000","last_unstale":"2024-09-21T07:00:22.559402+0000","last_undegraded":"2024-09-21T07:00:22.559402+0000","last_fullsized":"2024-09-21T07:00:22.559402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:49.233183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679135+0000","last_change":"2024-09-21T07:00:21.560398+0000","last_active":"2024-09-21T07:00:22.679135+0000","last_peered":"2024-09-21T07:00:22.679135+0000","last_clean":"2024-09-21T07:00:22.679135+0000","last_became_active":"2024-09-21T07:00:21.559982+0000","last_became_peered":"2024-09-21T07:00:21.559982+0000","last_unstale":"2024-09-21T07:00:22.679135+0000","last_undegraded":"2024-09-21T07:00:22.679135+0000","last_fullsized":"2024-09-21T07:00:22.679135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:03.253724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679057+0000","last_change":"2024-09-21T07:00:20.550595+0000","last_active":"2024-09-21T07:00:22.679057+0000","last_peered":"2024-09-21T07:00:22.679057+0000","last_clean":"2024-09-21T07:00:22.679057+0000","last_became_active":"2024-09-21T07:00:20.550200+0000","last_became_peered":"2024-09-21T07:00:20.550200+0000","last_unstale":"2024-09-21T07:00:22.679057+0000","last_undegraded":"2024-09-21T07:00:22.679057+0000","last_fullsized":"2024-09-21T07:00:22.679057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:18.707436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679134+0000","last_change":"2024-09-21T07:00:21.560750+0000","last_active":"2024-09-21T07:00:22.679134+0000","last_peered":"2024-09-21T07:00:22.679134+0000","last_clean":"2024-09-21T07:00:22.679134+0000","last_became_active":"2024-09-21T07:00:21.560441+0000","last_became_peered":"2024-09-21T07:00:21.560441+0000","last_unstale":"2024-09-21T07:00:22.679134+0000","last_undegraded":"2024-09-21T07:00:22.679134+0000","last_fullsized":"2024-09-21T07:00:22.679134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.279791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555799+0000","last_change":"2024-09-21T07:00:20.544906+0000","last_active":"2024-09-21T07:00:22.555799+0000","last_peered":"2024-09-21T07:00:22.555799+0000","last_clean":"2024-09-21T07:00:22.555799+0000","last_became_active":"2024-09-21T07:00:20.544498+0000","last_became_peered":"2024-09-21T07:00:20.544498+0000","last_unstale":"2024-09-21T07:00:22.555799+0000","last_undegraded":"2024-09-21T07:00:22.555799+0000","last_fullsized":"2024-09-21T07:00:22.555799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:44.271032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555684+0000","last_change":"2024-09-21T07:00:21.564804+0000","last_active":"2024-09-21T07:00:22.555684+0000","last_peered":"2024-09-21T07:00:22.555684+0000","last_clean":"2024-09-21T07:00:22.555684+0000","last_became_active":"2024-09-21T07:00:21.561696+0000","last_became_peered":"2024-09-21T07:00:21.561696+0000","last_unstale":"2024-09-21T07:00:22.555684+0000","last_undegraded":"2024-09-21T07:00:22.555684+0000","last_fullsized":"2024-09-21T07:00:22.555684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:49.943900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678454+0000","last_change":"2024-09-21T07:00:20.557556+0000","last_active":"2024-09-21T07:00:22.678454+0000","last_peered":"2024-09-21T07:00:22.678454+0000","last_clean":"2024-09-21T07:00:22.678454+0000","last_became_active":"2024-09-21T07:00:20.557169+0000","last_became_peered":"2024-09-21T07:00:20.557169+0000","last_unstale":"2024-09-21T07:00:22.678454+0000","last_undegraded":"2024-09-21T07:00:22.678454+0000","last_fullsized":"2024-09-21T07:00:22.678454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:17.973920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678272+0000","last_change":"2024-09-21T07:00:21.561779+0000","last_active":"2024-09-21T07:00:22.678272+0000","last_peered":"2024-09-21T07:00:22.678272+0000","last_clean":"2024-09-21T07:00:22.678272+0000","last_became_active":"2024-09-21T07:00:21.559267+0000","last_became_peered":"2024-09-21T07:00:21.559267+0000","last_unstale":"2024-09-21T07:00:22.678272+0000","last_undegraded":"2024-09-21T07:00:22.678272+0000","last_fullsized":"2024-09-21T07:00:22.678272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:30.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559457+0000","last_change":"2024-09-21T07:00:20.549484+0000","last_active":"2024-09-21T07:00:22.559457+0000","last_peered":"2024-09-21T07:00:22.559457+0000","last_clean":"2024-09-21T07:00:22.559457+0000","last_became_active":"2024-09-21T07:00:20.549138+0000","last_became_peered":"2024-09-21T07:00:20.549138+0000","last_unstale":"2024-09-21T07:00:22.559457+0000","last_undegraded":"2024-09-21T07:00:22.559457+0000","last_fullsized":"2024-09-21T07:00:22.559457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:49.823889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555525+0000","last_change":"2024-09-21T07:00:21.553588+0000","last_active":"2024-09-21T07:00:22.555525+0000","last_peered":"2024-09-21T07:00:22.555525+0000","last_clean":"2024-09-21T07:00:22.555525+0000","last_became_active":"2024-09-21T07:00:21.553198+0000","last_became_peered":"2024-09-21T07:00:21.553198+0000","last_unstale":"2024-09-21T07:00:22.555525+0000","last_undegraded":"2024-09-21T07:00:22.555525+0000","last_fullsized":"2024-09-21T07:00:22.555525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:10.283749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679331+0000","last_change":"2024-09-21T07:00:20.556500+0000","last_active":"2024-09-21T07:00:22.679331+0000","last_peered":"2024-09-21T07:00:22.679331+0000","last_clean":"2024-09-21T07:00:22.679331+0000","last_became_active":"2024-09-21T07:00:20.556193+0000","last_became_peered":"2024-09-21T07:00:20.556193+0000","last_unstale":"2024-09-21T07:00:22.679331+0000","last_undegraded":"2024-09-21T07:00:22.679331+0000","last_fullsized":"2024-09-21T07:00:22.679331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:58.055286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559733+0000","last_change":"2024-09-21T07:00:21.565347+0000","last_active":"2024-09-21T07:00:22.559733+0000","last_peered":"2024-09-21T07:00:22.559733+0000","last_clean":"2024-09-21T07:00:22.559733+0000","last_became_active":"2024-09-21T07:00:21.565023+0000","last_became_peered":"2024-09-21T07:00:21.565023+0000","last_unstale":"2024-09-21T07:00:22.559733+0000","last_undegraded":"2024-09-21T07:00:22.559733+0000","last_fullsized":"2024-09-21T07:00:22.559733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:45.276577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559893+0000","last_change":"2024-09-21T07:00:20.546640+0000","last_active":"2024-09-21T07:00:22.559893+0000","last_peered":"2024-09-21T07:00:22.559893+0000","last_clean":"2024-09-21T07:00:22.559893+0000","last_became_active":"2024-09-21T07:00:20.545583+0000","last_became_peered":"2024-09-21T07:00:20.545583+0000","last_unstale":"2024-09-21T07:00:22.559893+0000","last_undegraded":"2024-09-21T07:00:22.559893+0000","last_fullsized":"2024-09-21T07:00:22.559893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:24.006199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679347+0000","last_change":"2024-09-21T07:00:21.562929+0000","last_active":"2024-09-21T07:00:22.679347+0000","last_peered":"2024-09-21T07:00:22.679347+0000","last_clean":"2024-09-21T07:00:22.679347+0000","last_became_active":"2024-09-21T07:00:21.560634+0000","last_became_peered":"2024-09-21T07:00:21.560634+0000","last_unstale":"2024-09-21T07:00:22.679347+0000","last_undegraded":"2024-09-21T07:00:22.679347+0000","last_fullsized":"2024-09-21T07:00:22.679347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:55.968830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679904+0000","last_change":"2024-09-21T07:00:20.547808+0000","last_active":"2024-09-21T07:00:22.679904+0000","last_peered":"2024-09-21T07:00:22.679904+0000","last_clean":"2024-09-21T07:00:22.679904+0000","last_became_active":"2024-09-21T07:00:20.547399+0000","last_became_peered":"2024-09-21T07:00:20.547399+0000","last_unstale":"2024-09-21T07:00:22.679904+0000","last_undegraded":"2024-09-21T07:00:22.679904+0000","last_fullsized":"2024-09-21T07:00:22.679904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:31.765643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679015+0000","last_change":"2024-09-21T07:00:21.565188+0000","last_active":"2024-09-21T07:00:22.679015+0000","last_peered":"2024-09-21T07:00:22.679015+0000","last_clean":"2024-09-21T07:00:22.679015+0000","last_became_active":"2024-09-21T07:00:21.564511+0000","last_became_peered":"2024-09-21T07:00:21.564511+0000","last_unstale":"2024-09-21T07:00:22.679015+0000","last_undegraded":"2024-09-21T07:00:22.679015+0000","last_fullsized":"2024-09-21T07:00:22.679015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:11.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679575+0000","last_change":"2024-09-21T07:00:20.559723+0000","last_active":"2024-09-21T07:00:22.679575+0000","last_peered":"2024-09-21T07:00:22.679575+0000","last_clean":"2024-09-21T07:00:22.679575+0000","last_became_active":"2024-09-21T07:00:20.559395+0000","last_became_peered":"2024-09-21T07:00:20.559395+0000","last_unstale":"2024-09-21T07:00:22.679575+0000","last_undegraded":"2024-09-21T07:00:22.679575+0000","last_fullsized":"2024-09-21T07:00:22.679575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:11.305896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556037+0000","last_change":"2024-09-21T07:00:21.555249+0000","last_active":"2024-09-21T07:00:22.556037+0000","last_peered":"2024-09-21T07:00:22.556037+0000","last_clean":"2024-09-21T07:00:22.556037+0000","last_became_active":"2024-09-21T07:00:21.554923+0000","last_became_peered":"2024-09-21T07:00:21.554923+0000","last_unstale":"2024-09-21T07:00:22.556037+0000","last_undegraded":"2024-09-21T07:00:22.556037+0000","last_fullsized":"2024-09-21T07:00:22.556037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:35.387921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.677846+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:00:22.677846+0000","last_peered":"2024-09-21T07:00:22.677846+0000","last_clean":"2024-09-21T07:00:22.677846+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:00:22.677846+0000","last_undegraded":"2024-09-21T07:00:22.677846+0000","last_fullsized":"2024-09-21T07:00:22.677846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555751+0000","last_change":"2024-09-21T07:00:20.553179+0000","last_active":"2024-09-21T07:00:22.555751+0000","last_peered":"2024-09-21T07:00:22.555751+0000","last_clean":"2024-09-21T07:00:22.555751+0000","last_became_active":"2024-09-21T07:00:20.552827+0000","last_became_peered":"2024-09-21T07:00:20.552827+0000","last_unstale":"2024-09-21T07:00:22.555751+0000","last_undegraded":"2024-09-21T07:00:22.555751+0000","last_fullsized":"2024-09-21T07:00:22.555751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:08.559468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560027+0000","last_change":"2024-09-21T07:00:21.555846+0000","last_active":"2024-09-21T07:00:22.560027+0000","last_peered":"2024-09-21T07:00:22.560027+0000","last_clean":"2024-09-21T07:00:22.560027+0000","last_became_active":"2024-09-21T07:00:21.555489+0000","last_became_peered":"2024-09-21T07:00:21.555489+0000","last_unstale":"2024-09-21T07:00:22.560027+0000","last_undegraded":"2024-09-21T07:00:22.560027+0000","last_fullsized":"2024-09-21T07:00:22.560027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:46.262263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555611+0000","last_change":"2024-09-21T07:00:20.548323+0000","last_active":"2024-09-21T07:00:22.555611+0000","last_peered":"2024-09-21T07:00:22.555611+0000","last_clean":"2024-09-21T07:00:22.555611+0000","last_became_active":"2024-09-21T07:00:20.547621+0000","last_became_peered":"2024-09-21T07:00:20.547621+0000","last_unstale":"2024-09-21T07:00:22.555611+0000","last_undegraded":"2024-09-21T07:00:22.555611+0000","last_fullsized":"2024-09-21T07:00:22.555611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:55.956461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679034+0000","last_change":"2024-09-21T07:00:21.551894+0000","last_active":"2024-09-21T07:00:22.679034+0000","last_peered":"2024-09-21T07:00:22.679034+0000","last_clean":"2024-09-21T07:00:22.679034+0000","last_became_active":"2024-09-21T07:00:21.551591+0000","last_became_peered":"2024-09-21T07:00:21.551591+0000","last_unstale":"2024-09-21T07:00:22.679034+0000","last_undegraded":"2024-09-21T07:00:22.679034+0000","last_fullsized":"2024-09-21T07:00:22.679034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:47.346271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678891+0000","last_change":"2024-09-21T07:00:20.547964+0000","last_active":"2024-09-21T07:00:22.678891+0000","last_peered":"2024-09-21T07:00:22.678891+0000","last_clean":"2024-09-21T07:00:22.678891+0000","last_became_active":"2024-09-21T07:00:20.547608+0000","last_became_peered":"2024-09-21T07:00:20.547608+0000","last_unstale":"2024-09-21T07:00:22.678891+0000","last_undegraded":"2024-09-21T07:00:22.678891+0000","last_fullsized":"2024-09-21T07:00:22.678891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:22.996288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680136+0000","last_change":"2024-09-21T07:00:21.561842+0000","last_active":"2024-09-21T07:00:22.680136+0000","last_peered":"2024-09-21T07:00:22.680136+0000","last_clean":"2024-09-21T07:00:22.680136+0000","last_became_active":"2024-09-21T07:00:21.561384+0000","last_became_peered":"2024-09-21T07:00:21.561384+0000","last_unstale":"2024-09-21T07:00:22.680136+0000","last_undegraded":"2024-09-21T07:00:22.680136+0000","last_fullsized":"2024-09-21T07:00:22.680136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:36.431383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555896+0000","last_change":"2024-09-21T07:00:20.549703+0000","last_active":"2024-09-21T07:00:22.555896+0000","last_peered":"2024-09-21T07:00:22.555896+0000","last_clean":"2024-09-21T07:00:22.555896+0000","last_became_active":"2024-09-21T07:00:20.549357+0000","last_became_peered":"2024-09-21T07:00:20.549357+0000","last_unstale":"2024-09-21T07:00:22.555896+0000","last_undegraded":"2024-09-21T07:00:22.555896+0000","last_fullsized":"2024-09-21T07:00:22.555896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:29.640468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678977+0000","last_change":"2024-09-21T07:00:21.567956+0000","last_active":"2024-09-21T07:00:22.678977+0000","last_peered":"2024-09-21T07:00:22.678977+0000","last_clean":"2024-09-21T07:00:22.678977+0000","last_became_active":"2024-09-21T07:00:21.567178+0000","last_became_peered":"2024-09-21T07:00:21.567178+0000","last_unstale":"2024-09-21T07:00:22.678977+0000","last_undegraded":"2024-09-21T07:00:22.678977+0000","last_fullsized":"2024-09-21T07:00:22.678977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:44.374303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679584+0000","last_change":"2024-09-21T07:00:20.549555+0000","last_active":"2024-09-21T07:00:22.679584+0000","last_peered":"2024-09-21T07:00:22.679584+0000","last_clean":"2024-09-21T07:00:22.679584+0000","last_became_active":"2024-09-21T07:00:20.549225+0000","last_became_peered":"2024-09-21T07:00:20.549225+0000","last_unstale":"2024-09-21T07:00:22.679584+0000","last_undegraded":"2024-09-21T07:00:22.679584+0000","last_fullsized":"2024-09-21T07:00:22.679584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:21.053297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559576+0000","last_change":"2024-09-21T07:00:21.557887+0000","last_active":"2024-09-21T07:00:22.559576+0000","last_peered":"2024-09-21T07:00:22.559576+0000","last_clean":"2024-09-21T07:00:22.559576+0000","last_became_active":"2024-09-21T07:00:21.557553+0000","last_became_peered":"2024-09-21T07:00:21.557553+0000","last_unstale":"2024-09-21T07:00:22.559576+0000","last_undegraded":"2024-09-21T07:00:22.559576+0000","last_fullsized":"2024-09-21T07:00:22.559576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:18.578209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556104+0000","last_change":"2024-09-21T07:00:20.543420+0000","last_active":"2024-09-21T07:00:22.556104+0000","last_peered":"2024-09-21T07:00:22.556104+0000","last_clean":"2024-09-21T07:00:22.556104+0000","last_became_active":"2024-09-21T07:00:20.542474+0000","last_became_peered":"2024-09-21T07:00:20.542474+0000","last_unstale":"2024-09-21T07:00:22.556104+0000","last_undegraded":"2024-09-21T07:00:22.556104+0000","last_fullsized":"2024-09-21T07:00:22.556104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:39.027438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679418+0000","last_change":"2024-09-21T07:00:21.559801+0000","last_active":"2024-09-21T07:00:22.679418+0000","last_peered":"2024-09-21T07:00:22.679418+0000","last_clean":"2024-09-21T07:00:22.679418+0000","last_became_active":"2024-09-21T07:00:21.559042+0000","last_became_peered":"2024-09-21T07:00:21.559042+0000","last_unstale":"2024-09-21T07:00:22.679418+0000","last_undegraded":"2024-09-21T07:00:22.679418+0000","last_fullsized":"2024-09-21T07:00:22.679418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:43.510885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560076+0000","last_change":"2024-09-21T07:00:20.555344+0000","last_active":"2024-09-21T07:00:22.560076+0000","last_peered":"2024-09-21T07:00:22.560076+0000","last_clean":"2024-09-21T07:00:22.560076+0000","last_became_active":"2024-09-21T07:00:20.555062+0000","last_became_peered":"2024-09-21T07:00:20.555062+0000","last_unstale":"2024-09-21T07:00:22.560076+0000","last_undegraded":"2024-09-21T07:00:22.560076+0000","last_fullsized":"2024-09-21T07:00:22.560076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:48.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560218+0000","last_change":"2024-09-21T07:00:21.555637+0000","last_active":"2024-09-21T07:00:22.560218+0000","last_peered":"2024-09-21T07:00:22.560218+0000","last_clean":"2024-09-21T07:00:22.560218+0000","last_became_active":"2024-09-21T07:00:21.554035+0000","last_became_peered":"2024-09-21T07:00:21.554035+0000","last_unstale":"2024-09-21T07:00:22.560218+0000","last_undegraded":"2024-09-21T07:00:22.560218+0000","last_fullsized":"2024-09-21T07:00:22.560218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:32.424218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556233+0000","last_change":"2024-09-21T07:00:20.557912+0000","last_active":"2024-09-21T07:00:22.556233+0000","last_peered":"2024-09-21T07:00:22.556233+0000","last_clean":"2024-09-21T07:00:22.556233+0000","last_became_active":"2024-09-21T07:00:20.557639+0000","last_became_peered":"2024-09-21T07:00:20.557639+0000","last_unstale":"2024-09-21T07:00:22.556233+0000","last_undegraded":"2024-09-21T07:00:22.556233+0000","last_fullsized":"2024-09-21T07:00:22.556233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:58.055286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559735+0000","last_change":"2024-09-21T07:00:21.559146+0000","last_active":"2024-09-21T07:00:22.559735+0000","last_peered":"2024-09-21T07:00:22.559735+0000","last_clean":"2024-09-21T07:00:22.559735+0000","last_became_active":"2024-09-21T07:00:21.558843+0000","last_became_peered":"2024-09-21T07:00:21.558843+0000","last_unstale":"2024-09-21T07:00:22.559735+0000","last_undegraded":"2024-09-21T07:00:22.559735+0000","last_fullsized":"2024-09-21T07:00:22.559735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.986967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.677871+0000","last_change":"2024-09-21T07:00:20.554827+0000","last_active":"2024-09-21T07:00:22.677871+0000","last_peered":"2024-09-21T07:00:22.677871+0000","last_clean":"2024-09-21T07:00:22.677871+0000","last_became_active":"2024-09-21T07:00:20.554492+0000","last_became_peered":"2024-09-21T07:00:20.554492+0000","last_unstale":"2024-09-21T07:00:22.677871+0000","last_undegraded":"2024-09-21T07:00:22.677871+0000","last_fullsized":"2024-09-21T07:00:22.677871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:31.765643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555783+0000","last_change":"2024-09-21T07:00:21.544580+0000","last_active":"2024-09-21T07:00:22.555783+0000","last_peered":"2024-09-21T07:00:22.555783+0000","last_clean":"2024-09-21T07:00:22.555783+0000","last_became_active":"2024-09-21T07:00:21.544183+0000","last_became_peered":"2024-09-21T07:00:21.544183+0000","last_unstale":"2024-09-21T07:00:22.555783+0000","last_undegraded":"2024-09-21T07:00:22.555783+0000","last_fullsized":"2024-09-21T07:00:22.555783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:16.805232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560063+0000","last_change":"2024-09-21T07:00:20.554018+0000","last_active":"2024-09-21T07:00:22.560063+0000","last_peered":"2024-09-21T07:00:22.560063+0000","last_clean":"2024-09-21T07:00:22.560063+0000","last_became_active":"2024-09-21T07:00:20.553671+0000","last_became_peered":"2024-09-21T07:00:20.553671+0000","last_unstale":"2024-09-21T07:00:22.560063+0000","last_undegraded":"2024-09-21T07:00:22.560063+0000","last_fullsized":"2024-09-21T07:00:22.560063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:05.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559563+0000","last_change":"2024-09-21T07:00:21.557634+0000","last_active":"2024-09-21T07:00:22.559563+0000","last_peered":"2024-09-21T07:00:22.559563+0000","last_clean":"2024-09-21T07:00:22.559563+0000","last_became_active":"2024-09-21T07:00:21.557321+0000","last_became_peered":"2024-09-21T07:00:21.557321+0000","last_unstale":"2024-09-21T07:00:22.559563+0000","last_undegraded":"2024-09-21T07:00:22.559563+0000","last_fullsized":"2024-09-21T07:00:22.559563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:30.043686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679867+0000","last_change":"2024-09-21T07:00:20.549405+0000","last_active":"2024-09-21T07:00:22.679867+0000","last_peered":"2024-09-21T07:00:22.679867+0000","last_clean":"2024-09-21T07:00:22.679867+0000","last_became_active":"2024-09-21T07:00:20.549054+0000","last_became_peered":"2024-09-21T07:00:20.549054+0000","last_unstale":"2024-09-21T07:00:22.679867+0000","last_undegraded":"2024-09-21T07:00:22.679867+0000","last_fullsized":"2024-09-21T07:00:22.679867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:33.810421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678789+0000","last_change":"2024-09-21T07:00:21.558561+0000","last_active":"2024-09-21T07:00:22.678789+0000","last_peered":"2024-09-21T07:00:22.678789+0000","last_clean":"2024-09-21T07:00:22.678789+0000","last_became_active":"2024-09-21T07:00:21.558261+0000","last_became_peered":"2024-09-21T07:00:21.558261+0000","last_unstale":"2024-09-21T07:00:22.678789+0000","last_undegraded":"2024-09-21T07:00:22.678789+0000","last_fullsized":"2024-09-21T07:00:22.678789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:59.060831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555611+0000","last_change":"2024-09-21T07:00:20.553936+0000","last_active":"2024-09-21T07:00:22.555611+0000","last_peered":"2024-09-21T07:00:22.555611+0000","last_clean":"2024-09-21T07:00:22.555611+0000","last_became_active":"2024-09-21T07:00:20.553519+0000","last_became_peered":"2024-09-21T07:00:20.553519+0000","last_unstale":"2024-09-21T07:00:22.555611+0000","last_undegraded":"2024-09-21T07:00:22.555611+0000","last_fullsized":"2024-09-21T07:00:22.555611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:45.606392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555730+0000","last_change":"2024-09-21T07:00:21.561189+0000","last_active":"2024-09-21T07:00:22.555730+0000","last_peered":"2024-09-21T07:00:22.555730+0000","last_clean":"2024-09-21T07:00:22.555730+0000","last_became_active":"2024-09-21T07:00:21.560624+0000","last_became_peered":"2024-09-21T07:00:21.560624+0000","last_unstale":"2024-09-21T07:00:22.555730+0000","last_undegraded":"2024-09-21T07:00:22.555730+0000","last_fullsized":"2024-09-21T07:00:22.555730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:18.852711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556021+0000","last_change":"2024-09-21T07:00:21.562747+0000","last_active":"2024-09-21T07:00:22.556021+0000","last_peered":"2024-09-21T07:00:22.556021+0000","last_clean":"2024-09-21T07:00:22.556021+0000","last_became_active":"2024-09-21T07:00:21.561878+0000","last_became_peered":"2024-09-21T07:00:21.561878+0000","last_unstale":"2024-09-21T07:00:22.556021+0000","last_undegraded":"2024-09-21T07:00:22.556021+0000","last_fullsized":"2024-09-21T07:00:22.556021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:55.182037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679152+0000","last_change":"2024-09-21T07:00:20.544327+0000","last_active":"2024-09-21T07:00:22.679152+0000","last_peered":"2024-09-21T07:00:22.679152+0000","last_clean":"2024-09-21T07:00:22.679152+0000","last_became_active":"2024-09-21T07:00:20.542769+0000","last_became_peered":"2024-09-21T07:00:20.542769+0000","last_unstale":"2024-09-21T07:00:22.679152+0000","last_undegraded":"2024-09-21T07:00:22.679152+0000","last_fullsized":"2024-09-21T07:00:22.679152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:29.345084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678441+0000","last_change":"2024-09-21T07:00:21.569453+0000","last_active":"2024-09-21T07:00:22.678441+0000","last_peered":"2024-09-21T07:00:22.678441+0000","last_clean":"2024-09-21T07:00:22.678441+0000","last_became_active":"2024-09-21T07:00:21.569117+0000","last_became_peered":"2024-09-21T07:00:21.569117+0000","last_unstale":"2024-09-21T07:00:22.678441+0000","last_undegraded":"2024-09-21T07:00:22.678441+0000","last_fullsized":"2024-09-21T07:00:22.678441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:56.962006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679022+0000","last_change":"2024-09-21T07:00:20.547783+0000","last_active":"2024-09-21T07:00:22.679022+0000","last_peered":"2024-09-21T07:00:22.679022+0000","last_clean":"2024-09-21T07:00:22.679022+0000","last_became_active":"2024-09-21T07:00:20.547538+0000","last_became_peered":"2024-09-21T07:00:20.547538+0000","last_unstale":"2024-09-21T07:00:22.679022+0000","last_undegraded":"2024-09-21T07:00:22.679022+0000","last_fullsized":"2024-09-21T07:00:22.679022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.323272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680155+0000","last_change":"2024-09-21T07:00:21.557083+0000","last_active":"2024-09-21T07:00:22.680155+0000","last_peered":"2024-09-21T07:00:22.680155+0000","last_clean":"2024-09-21T07:00:22.680155+0000","last_became_active":"2024-09-21T07:00:21.556772+0000","last_became_peered":"2024-09-21T07:00:21.556772+0000","last_unstale":"2024-09-21T07:00:22.680155+0000","last_undegraded":"2024-09-21T07:00:22.680155+0000","last_fullsized":"2024-09-21T07:00:22.680155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:51.527888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680187+0000","last_change":"2024-09-21T07:00:20.543213+0000","last_active":"2024-09-21T07:00:22.680187+0000","last_peered":"2024-09-21T07:00:22.680187+0000","last_clean":"2024-09-21T07:00:22.680187+0000","last_became_active":"2024-09-21T07:00:20.542780+0000","last_became_peered":"2024-09-21T07:00:20.542780+0000","last_unstale":"2024-09-21T07:00:22.680187+0000","last_undegraded":"2024-09-21T07:00:22.680187+0000","last_fullsized":"2024-09-21T07:00:22.680187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.323272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680085+0000","last_change":"2024-09-21T07:00:21.566777+0000","last_active":"2024-09-21T07:00:22.680085+0000","last_peered":"2024-09-21T07:00:22.680085+0000","last_clean":"2024-09-21T07:00:22.680085+0000","last_became_active":"2024-09-21T07:00:21.566472+0000","last_became_peered":"2024-09-21T07:00:21.566472+0000","last_unstale":"2024-09-21T07:00:22.680085+0000","last_undegraded":"2024-09-21T07:00:22.680085+0000","last_fullsized":"2024-09-21T07:00:22.680085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:20.812379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560188+0000","last_change":"2024-09-21T07:00:20.544364+0000","last_active":"2024-09-21T07:00:22.560188+0000","last_peered":"2024-09-21T07:00:22.560188+0000","last_clean":"2024-09-21T07:00:22.560188+0000","last_became_active":"2024-09-21T07:00:20.543152+0000","last_became_peered":"2024-09-21T07:00:20.543152+0000","last_unstale":"2024-09-21T07:00:22.560188+0000","last_undegraded":"2024-09-21T07:00:22.560188+0000","last_fullsized":"2024-09-21T07:00:22.560188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:24.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":823296,"data_stored":667024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":77146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":78176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":78848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:00:30.484 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:00:30.484 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-21T07:00:30.485 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T07:00:30.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.635+0000 7f081b8da640 1 -- 172.21.15.63:0/1975853959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08140b7530 msgr2=0x7f08140d2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:30.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.635+0000 7f081b8da640 1 --2- 172.21.15.63:0/1975853959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08140b7530 0x7f08140d2530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f08140ba3a0 tx=0x7f081002a5f0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.635+0000 7f081b8da640 1 -- 172.21.15.63:0/1975853959 shutdown_connections 2024-09-21T07:00:30.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.635+0000 7f081b8da640 1 --2- 172.21.15.63:0/1975853959 >> v2:172.21.15.71:3300/0 conn(0x7f08140cf310 0x7f08140cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.635+0000 7f081b8da640 1 --2- 172.21.15.63:0/1975853959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08140b7530 0x7f08140d2530 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.635+0000 7f081b8da640 1 -- 172.21.15.63:0/1975853959 >> 172.21.15.63:0/1975853959 conn(0x7f081408bfd0 msgr2=0x7f08140d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:30.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.635+0000 7f081b8da640 1 -- 172.21.15.63:0/1975853959 shutdown_connections 2024-09-21T07:00:30.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.635+0000 7f081b8da640 1 -- 172.21.15.63:0/1975853959 wait complete. 2024-09-21T07:00:30.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.637+0000 7f081b8da640 1 Processor -- start 2024-09-21T07:00:30.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.637+0000 7f081b8da640 1 -- start start 2024-09-21T07:00:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.638+0000 7f081b8da640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08140b7530 0x7f0814158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.638+0000 7f081b8da640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08140cf310 0x7f08141f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.638+0000 7f081b8da640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f081415ef00 0x7f08141f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.638+0000 7f081b8da640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f08140cfff0 con 0x7f08140b7530 2024-09-21T07:00:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.638+0000 7f081b8da640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f08140cfe70 con 0x7f08140cf310 2024-09-21T07:00:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.638+0000 7f081b8da640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f08140d0170 con 0x7f081415ef00 2024-09-21T07:00:30.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.638+0000 7f0819676640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08140b7530 0x7f0814158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.638+0000 7f0819676640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08140b7530 0x7f0814158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36712/0 (socket says 172.21.15.63:36712) 2024-09-21T07:00:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.638+0000 7f0819676640 1 -- 172.21.15.63:0/2171728140 learned_addr learned my addr 172.21.15.63:0/2171728140 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.638+0000 7f0818e75640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08140cf310 0x7f08141f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.638+0000 7f0819e77640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f081415ef00 0x7f08141f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.639+0000 7f0819676640 1 -- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f081415ef00 msgr2=0x7f08141f91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.639+0000 7f0819676640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f081415ef00 0x7f08141f91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.639+0000 7f0819676640 1 -- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08140cf310 msgr2=0x7f08141f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.639+0000 7f0819676640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08140cf310 0x7f08141f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.639+0000 7f0819676640 1 -- 172.21.15.63:0/2171728140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081415fa80 con 0x7f08140b7530 2024-09-21T07:00:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.639+0000 7f0819676640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08140b7530 0x7f0814158890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f081002abe0 tx=0x7f08100052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.639+0000 7f0809ffb640 1 -- 172.21.15.63:0/2171728140 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810005cf0 con 0x7f08140b7530 2024-09-21T07:00:30.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.639+0000 7f0809ffb640 1 -- 172.21.15.63:0/2171728140 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0810031c40 con 0x7f08140b7530 2024-09-21T07:00:30.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.639+0000 7f081b8da640 1 -- 172.21.15.63:0/2171728140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081415fef0 con 0x7f08140b7530 2024-09-21T07:00:30.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.639+0000 7f0809ffb640 1 -- 172.21.15.63:0/2171728140 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810004a00 con 0x7f08140b7530 2024-09-21T07:00:30.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.639+0000 7f081b8da640 1 -- 172.21.15.63:0/2171728140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08141604b0 con 0x7f08140b7530 2024-09-21T07:00:30.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.640+0000 7f081b8da640 1 -- 172.21.15.63:0/2171728140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0814162330 con 0x7f08140b7530 2024-09-21T07:00:30.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.641+0000 7f0809ffb640 1 -- 172.21.15.63:0/2171728140 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0810004ba0 con 0x7f08140b7530 2024-09-21T07:00:30.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.641+0000 7f0809ffb640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f07f8078bc0 0x7f07f807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:30.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.641+0000 7f0809ffb640 1 -- 172.21.15.63:0/2171728140 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f08100bc160 con 0x7f08140b7530 2024-09-21T07:00:30.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.641+0000 7f0818e75640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f07f8078bc0 0x7f07f807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:30.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.642+0000 7f0818e75640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f07f8078bc0 0x7f07f807b0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f081406fb50 tx=0x7f0804009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:30.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.646+0000 7f0809ffb640 1 -- 172.21.15.63:0/2171728140 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f081003f030 con 0x7f08140b7530 2024-09-21T07:00:30.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.838+0000 7f081b8da640 1 -- 172.21.15.63:0/2171728140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f08140d0670 con 0x7f08140b7530 2024-09-21T07:00:30.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.839+0000 7f0809ffb640 1 -- 172.21.15.63:0/2171728140 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7f0810084630 con 0x7f08140b7530 2024-09-21T07:00:30.841 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:30.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.841+0000 7f081b8da640 1 -- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f07f8078bc0 msgr2=0x7f07f807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:30.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.841+0000 7f081b8da640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f07f8078bc0 0x7f07f807b0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f081406fb50 tx=0x7f0804009040 comp rx=0 tx=0).stop 2024-09-21T07:00:30.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.841+0000 7f081b8da640 1 -- 172.21.15.63:0/2171728140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08140b7530 msgr2=0x7f0814158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:30.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.841+0000 7f081b8da640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08140b7530 0x7f0814158890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f081002abe0 tx=0x7f08100052f0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.841+0000 7f081b8da640 1 -- 172.21.15.63:0/2171728140 shutdown_connections 2024-09-21T07:00:30.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.841+0000 7f081b8da640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f07f8078bc0 0x7f07f807b0d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.841+0000 7f081b8da640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f081415ef00 0x7f08141f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.841+0000 7f081b8da640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08140cf310 0x7f08141f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.841+0000 7f081b8da640 1 --2- 172.21.15.63:0/2171728140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08140b7530 0x7f0814158890 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.841+0000 7f081b8da640 1 -- 172.21.15.63:0/2171728140 >> 172.21.15.63:0/2171728140 conn(0x7f081408bfd0 msgr2=0x7f081406ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:30.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.841+0000 7f081b8da640 1 -- 172.21.15.63:0/2171728140 shutdown_connections 2024-09-21T07:00:30.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.841+0000 7f081b8da640 1 -- 172.21.15.63:0/2171728140 wait complete. 2024-09-21T07:00:30.854 INFO:teuthology.orchestra.run.smithi063.stdout:[{"version":31,"timestamp":"2024-09-21T07:00:09.366146+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"4177.043557"}]}] 2024-09-21T07:00:30.854 INFO:tasks.ceph_manager:config epoch is 31 2024-09-21T07:00:30.854 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T07:00:30.855 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T07:00:30.855 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T07:00:30.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.969+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/3357978173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd80cf640 msgr2=0x7f1bd80cfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:30.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.969+0000 7f1bdeb2b640 1 --2- 172.21.15.63:0/3357978173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd80cf640 0x7f1bd80cfa50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc005fd0 tx=0x7f1bcc02a5d0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.969+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/3357978173 shutdown_connections 2024-09-21T07:00:30.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.969+0000 7f1bdeb2b640 1 --2- 172.21.15.63:0/3357978173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd80cf640 0x7f1bd80cfa50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.969+0000 7f1bdeb2b640 1 --2- 172.21.15.63:0/3357978173 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bd80c61e0 0x7f1bd80d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.969+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/3357978173 >> 172.21.15.63:0/3357978173 conn(0x7f1bd80b2f70 msgr2=0x7f1bd80b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:30.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.969+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/3357978173 shutdown_connections 2024-09-21T07:00:30.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.969+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/3357978173 wait complete. 2024-09-21T07:00:30.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.971+0000 7f1bdeb2b640 1 Processor -- start 2024-09-21T07:00:30.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.971+0000 7f1bdeb2b640 1 -- start start 2024-09-21T07:00:30.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.972+0000 7f1bdeb2b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bd80b5c90 0x7f1bd809edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:30.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.972+0000 7f1bdeb2b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd80c61e0 0x7f1bd80b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:30.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.972+0000 7f1bdeb2b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bd80cf640 0x7f1bd8148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:30.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.972+0000 7f1bdeb2b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd815f700 con 0x7f1bd80c61e0 2024-09-21T07:00:30.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.972+0000 7f1bdeb2b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd80b69c0 con 0x7f1bd80b5c90 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.972+0000 7f1bdeb2b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd815f880 con 0x7f1bd80cf640 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.972+0000 7f1bd7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd80c61e0 0x7f1bd80b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.972+0000 7f1bd7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd80c61e0 0x7f1bd80b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36726/0 (socket says 172.21.15.63:36726) 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.972+0000 7f1bd7fff640 1 -- 172.21.15.63:0/4293838148 learned_addr learned my addr 172.21.15.63:0/4293838148 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.972+0000 7f1bdc8c7640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bd80b5c90 0x7f1bd809edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.972+0000 7f1bdd0c8640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bd80cf640 0x7f1bd8148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.973+0000 7f1bd7fff640 1 -- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bd80cf640 msgr2=0x7f1bd8148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.973+0000 7f1bd7fff640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bd80cf640 0x7f1bd8148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.973+0000 7f1bd7fff640 1 -- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bd80b5c90 msgr2=0x7f1bd809edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.973+0000 7f1bd7fff640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bd80b5c90 0x7f1bd809edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.973+0000 7f1bd7fff640 1 -- 172.21.15.63:0/4293838148 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd80af2f0 con 0x7f1bd80c61e0 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.973+0000 7f1bd7fff640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd80c61e0 0x7f1bd80b1990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc006010 tx=0x7f1bcc0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.973+0000 7f1bd57fa640 1 -- 172.21.15.63:0/4293838148 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc03e030 con 0x7f1bd80c61e0 2024-09-21T07:00:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.973+0000 7f1bd57fa640 1 -- 172.21.15.63:0/4293838148 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bcc003ae0 con 0x7f1bd80c61e0 2024-09-21T07:00:30.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.973+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/4293838148 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd80af5d0 con 0x7f1bd80c61e0 2024-09-21T07:00:30.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.973+0000 7f1bd57fa640 1 -- 172.21.15.63:0/4293838148 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc035040 con 0x7f1bd80c61e0 2024-09-21T07:00:30.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.973+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/4293838148 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd80afb90 con 0x7f1bd80c61e0 2024-09-21T07:00:30.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.974+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/4293838148 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd80d0290 con 0x7f1bd80c61e0 2024-09-21T07:00:30.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.975+0000 7f1bd57fa640 1 -- 172.21.15.63:0/4293838148 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1bcc041030 con 0x7f1bd80c61e0 2024-09-21T07:00:30.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.975+0000 7f1bd57fa640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1bc4078b90 0x7f1bc407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:30.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.975+0000 7f1bd57fa640 1 -- 172.21.15.63:0/4293838148 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1bcc0bb210 con 0x7f1bd80c61e0 2024-09-21T07:00:30.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.976+0000 7f1bdc8c7640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1bc4078b90 0x7f1bc407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:30.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.976+0000 7f1bdc8c7640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1bc4078b90 0x7f1bc407b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009bb0 tx=0x7f1bc8005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:30.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:30.980+0000 7f1bd57fa640 1 -- 172.21.15.63:0/4293838148 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1bcc083000 con 0x7f1bd80c61e0 2024-09-21T07:00:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.219+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/4293838148 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f1bd80b3800 con 0x7f1bd80c61e0 2024-09-21T07:00:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.222+0000 7f1bd57fa640 1 -- 172.21.15.63:0/4293838148 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194714 (secure 0 0 0) 0x7f1bcc087a30 con 0x7f1bd80c61e0 2024-09-21T07:00:31.226 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:31.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.225+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1bc4078b90 msgr2=0x7f1bc407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:31.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.225+0000 7f1bdeb2b640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1bc4078b90 0x7f1bc407b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009bb0 tx=0x7f1bc8005f90 comp rx=0 tx=0).stop 2024-09-21T07:00:31.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.225+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/4293838148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd80c61e0 msgr2=0x7f1bd80b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:31.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.225+0000 7f1bdeb2b640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd80c61e0 0x7f1bd80b1990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc006010 tx=0x7f1bcc0035f0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.225+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/4293838148 shutdown_connections 2024-09-21T07:00:31.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.225+0000 7f1bdeb2b640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1bc4078b90 0x7f1bc407b0a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.225+0000 7f1bdeb2b640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1bd80cf640 0x7f1bd8148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.225+0000 7f1bdeb2b640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1bd80c61e0 0x7f1bd80b1990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.225+0000 7f1bdeb2b640 1 --2- 172.21.15.63:0/4293838148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1bd80b5c90 0x7f1bd809edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.225+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/4293838148 >> 172.21.15.63:0/4293838148 conn(0x7f1bd80b2f70 msgr2=0x7f1bd80701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:31.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.225+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/4293838148 shutdown_connections 2024-09-21T07:00:31.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.225+0000 7f1bdeb2b640 1 -- 172.21.15.63:0/4293838148 wait complete. 2024-09-21T07:00:31.237 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"flags":0,"active_gid":4114,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":3863064379},{"type":"v1","addr":"172.21.15.71:6801","nonce":3863064379}]},"active_addr":"172.21.15.71:6801/3863064379","active_change":"2024-09-21T07:00:00.588095+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":129691301}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":1141085615}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":2728639732}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.71:0","nonce":4227330611}]}]} 2024-09-21T07:00:31.241 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T07:00:31.241 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T07:00:31.241 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:00:31.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.355+0000 7f4e79a7e640 1 -- 172.21.15.63:0/2666309134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b52a0 msgr2=0x7f4e740b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.355+0000 7f4e79a7e640 1 --2- 172.21.15.63:0/2666309134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b52a0 0x7f4e740b56b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4e740b7c90 tx=0x7f4e6802a520 comp rx=0 tx=0).stop 2024-09-21T07:00:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.355+0000 7f4e79a7e640 1 -- 172.21.15.63:0/2666309134 shutdown_connections 2024-09-21T07:00:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.355+0000 7f4e79a7e640 1 --2- 172.21.15.63:0/2666309134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e740b52a0 0x7f4e740b56b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.355+0000 7f4e79a7e640 1 --2- 172.21.15.63:0/2666309134 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e740d0350 0x7f4e740d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.355+0000 7f4e79a7e640 1 -- 172.21.15.63:0/2666309134 >> 172.21.15.63:0/2666309134 conn(0x7f4e740ceed0 msgr2=0x7f4e740cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.355+0000 7f4e79a7e640 1 -- 172.21.15.63:0/2666309134 shutdown_connections 2024-09-21T07:00:31.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.355+0000 7f4e79a7e640 1 -- 172.21.15.63:0/2666309134 wait complete. 2024-09-21T07:00:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.357+0000 7f4e79a7e640 1 Processor -- start 2024-09-21T07:00:31.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.357+0000 7f4e79a7e640 1 -- start start 2024-09-21T07:00:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e79a7e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e740b52a0 0x7f4e7406f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e79a7e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e740d0350 0x7f4e74155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e79a7e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e74160bd0 0x7f4e740b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e79a7e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4e740b5bf0 con 0x7f4e74160bd0 2024-09-21T07:00:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e79a7e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4e740d0760 con 0x7f4e740d0350 2024-09-21T07:00:31.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e79a7e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4e740b8280 con 0x7f4e740b52a0 2024-09-21T07:00:31.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e73fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e74160bd0 0x7f4e740b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:31.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e73fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e74160bd0 0x7f4e740b0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36750/0 (socket says 172.21.15.63:36750) 2024-09-21T07:00:31.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e73fff640 1 -- 172.21.15.63:0/3675583195 learned_addr learned my addr 172.21.15.63:0/3675583195 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:31.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e737fe640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e740b52a0 0x7f4e7406f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:31.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e72ffd640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e740d0350 0x7f4e74155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:31.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e73fff640 1 -- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e740b52a0 msgr2=0x7f4e7406f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:31.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e73fff640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e740b52a0 0x7f4e7406f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e73fff640 1 -- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e740d0350 msgr2=0x7f4e74155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:31.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e73fff640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e740d0350 0x7f4e74155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e73fff640 1 -- 172.21.15.63:0/3675583195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7406f720 con 0x7f4e74160bd0 2024-09-21T07:00:31.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e73fff640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e74160bd0 0x7f4e740b0270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00c6e0 tx=0x7f4e6c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:31.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.359+0000 7f4e5bfff640 1 -- 172.21.15.63:0/3675583195 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c003b70 con 0x7f4e74160bd0 2024-09-21T07:00:31.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.360+0000 7f4e5bfff640 1 -- 172.21.15.63:0/3675583195 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e6c003d30 con 0x7f4e74160bd0 2024-09-21T07:00:31.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.360+0000 7f4e79a7e640 1 -- 172.21.15.63:0/3675583195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7406fc30 con 0x7f4e74160bd0 2024-09-21T07:00:31.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.360+0000 7f4e5bfff640 1 -- 172.21.15.63:0/3675583195 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c005330 con 0x7f4e74160bd0 2024-09-21T07:00:31.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.360+0000 7f4e79a7e640 1 -- 172.21.15.63:0/3675583195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e741f9200 con 0x7f4e74160bd0 2024-09-21T07:00:31.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.361+0000 7f4e79a7e640 1 -- 172.21.15.63:0/3675583195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e74075c80 con 0x7f4e74160bd0 2024-09-21T07:00:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.361+0000 7f4e5bfff640 1 -- 172.21.15.63:0/3675583195 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4e6c0054d0 con 0x7f4e74160bd0 2024-09-21T07:00:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.362+0000 7f4e5bfff640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4e60078b90 0x7f4e6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.362+0000 7f4e5bfff640 1 -- 172.21.15.63:0/3675583195 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4e6c09a930 con 0x7f4e74160bd0 2024-09-21T07:00:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.362+0000 7f4e737fe640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4e60078b90 0x7f4e6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.362+0000 7f4e737fe640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4e60078b90 0x7f4e6007b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e64004610 tx=0x7f4e6400b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:31.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.366+0000 7f4e5bfff640 1 -- 172.21.15.63:0/3675583195 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4e74075c80 con 0x7f4e74160bd0 2024-09-21T07:00:31.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.553+0000 7f4e79a7e640 1 -- 172.21.15.63:0/3675583195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e740b75e0 con 0x7f4e74160bd0 2024-09-21T07:00:31.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.554+0000 7f4e5bfff640 1 -- 172.21.15.63:0/3675583195 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7f4e6c0627b0 con 0x7f4e74160bd0 2024-09-21T07:00:31.556 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:31.556 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:00:22.544759+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:00:18.869431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:00:19.879189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:00:31.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.556+0000 7f4e79a7e640 1 -- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4e60078b90 msgr2=0x7f4e6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:31.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.556+0000 7f4e79a7e640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4e60078b90 0x7f4e6007b0a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e64004610 tx=0x7f4e6400b2e0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.556+0000 7f4e79a7e640 1 -- 172.21.15.63:0/3675583195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e74160bd0 msgr2=0x7f4e740b0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:31.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.556+0000 7f4e79a7e640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e74160bd0 0x7f4e740b0270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00c6e0 tx=0x7f4e6c00cba0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.556+0000 7f4e79a7e640 1 -- 172.21.15.63:0/3675583195 shutdown_connections 2024-09-21T07:00:31.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.556+0000 7f4e79a7e640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4e60078b90 0x7f4e6007b0a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.556+0000 7f4e79a7e640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4e74160bd0 0x7f4e740b0270 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.556+0000 7f4e79a7e640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e740d0350 0x7f4e74155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.556+0000 7f4e79a7e640 1 --2- 172.21.15.63:0/3675583195 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4e740b52a0 0x7f4e7406f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.556+0000 7f4e79a7e640 1 -- 172.21.15.63:0/3675583195 >> 172.21.15.63:0/3675583195 conn(0x7f4e740ceed0 msgr2=0x7f4e74156a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:31.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.556+0000 7f4e79a7e640 1 -- 172.21.15.63:0/3675583195 shutdown_connections 2024-09-21T07:00:31.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.556+0000 7f4e79a7e640 1 -- 172.21.15.63:0/3675583195 wait complete. 2024-09-21T07:00:31.569 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T07:00:31.570 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:00:31.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.684+0000 7fe0dcda1640 1 -- 172.21.15.63:0/1718067406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d80b3aa0 msgr2=0x7fe0d80d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:31.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.684+0000 7fe0dcda1640 1 --2- 172.21.15.63:0/1718067406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d80b3aa0 0x7fe0d80d2fd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80098e0 tx=0x7fe0c802a530 comp rx=0 tx=0).stop 2024-09-21T07:00:31.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.684+0000 7fe0dcda1640 1 -- 172.21.15.63:0/1718067406 shutdown_connections 2024-09-21T07:00:31.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.684+0000 7fe0dcda1640 1 --2- 172.21.15.63:0/1718067406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d80b3aa0 0x7fe0d80d2fd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.684+0000 7fe0dcda1640 1 -- 172.21.15.63:0/1718067406 >> 172.21.15.63:0/1718067406 conn(0x7fe0d80d45e0 msgr2=0x7fe0d80d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:31.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.684+0000 7fe0dcda1640 1 -- 172.21.15.63:0/1718067406 shutdown_connections 2024-09-21T07:00:31.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.684+0000 7fe0dcda1640 1 -- 172.21.15.63:0/1718067406 wait complete. 2024-09-21T07:00:31.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.686+0000 7fe0dcda1640 1 Processor -- start 2024-09-21T07:00:31.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.686+0000 7fe0dcda1640 1 -- start start 2024-09-21T07:00:31.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0dcda1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d80b3aa0 0x7fe0d80b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:31.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0dcda1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0d80b9aa0 0x7fe0d80ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:31.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0dcda1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d80b6770 0x7fe0d81591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:31.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0dcda1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d806f040 con 0x7fe0d80b3aa0 2024-09-21T07:00:31.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0dcda1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d808cb70 con 0x7fe0d80b6770 2024-09-21T07:00:31.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0dcda1640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d806f1c0 con 0x7fe0d80b9aa0 2024-09-21T07:00:31.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0d659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d80b3aa0 0x7fe0d80b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:31.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0d659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d80b3aa0 0x7fe0d80b6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36780/0 (socket says 172.21.15.63:36780) 2024-09-21T07:00:31.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0d659c640 1 -- 172.21.15.63:0/3284222188 learned_addr learned my addr 172.21.15.63:0/3284222188 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:31.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0d5d9b640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0d80b9aa0 0x7fe0d80ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:31.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0d659c640 1 -- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0d80b9aa0 msgr2=0x7fe0d80ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:31.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0d6d9d640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d80b6770 0x7fe0d81591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:31.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0d659c640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0d80b9aa0 0x7fe0d80ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0d659c640 1 -- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d80b6770 msgr2=0x7fe0d81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:31.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0d659c640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d80b6770 0x7fe0d81591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0d659c640 1 -- 172.21.15.63:0/3284222188 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d815a2f0 con 0x7fe0d80b3aa0 2024-09-21T07:00:31.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0d659c640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d80b3aa0 0x7fe0d80b6230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe0c802ab20 tx=0x7fe0c8004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:31.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0c6ffd640 1 -- 172.21.15.63:0/3284222188 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8031d60 con 0x7fe0d80b3aa0 2024-09-21T07:00:31.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0dcda1640 1 -- 172.21.15.63:0/3284222188 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d81f60b0 con 0x7fe0d80b3aa0 2024-09-21T07:00:31.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0c6ffd640 1 -- 172.21.15.63:0/3284222188 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0c80330d0 con 0x7fe0d80b3aa0 2024-09-21T07:00:31.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0c6ffd640 1 -- 172.21.15.63:0/3284222188 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80334e0 con 0x7fe0d80b3aa0 2024-09-21T07:00:31.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.688+0000 7fe0dcda1640 1 -- 172.21.15.63:0/3284222188 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d81f6670 con 0x7fe0d80b3aa0 2024-09-21T07:00:31.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.689+0000 7fe0dcda1640 1 -- 172.21.15.63:0/3284222188 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d80d2fd0 con 0x7fe0d80b3aa0 2024-09-21T07:00:31.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.690+0000 7fe0c6ffd640 1 -- 172.21.15.63:0/3284222188 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe0c8033680 con 0x7fe0d80b3aa0 2024-09-21T07:00:31.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.691+0000 7fe0c6ffd640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe0b8078bc0 0x7fe0b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:31.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.691+0000 7fe0c6ffd640 1 -- 172.21.15.63:0/3284222188 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe0c80bc230 con 0x7fe0d80b3aa0 2024-09-21T07:00:31.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.691+0000 7fe0d5d9b640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe0b8078bc0 0x7fe0b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:31.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.691+0000 7fe0d5d9b640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe0b8078bc0 0x7fe0b807b0d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc006fd0 tx=0x7fe0cc008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:31.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.695+0000 7fe0c6ffd640 1 -- 172.21.15.63:0/3284222188 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe0c803f030 con 0x7fe0d80b3aa0 2024-09-21T07:00:31.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.885+0000 7fe0dcda1640 1 -- 172.21.15.63:0/3284222188 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0d80b8700 con 0x7fe0d80b3aa0 2024-09-21T07:00:31.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.886+0000 7fe0c6ffd640 1 -- 172.21.15.63:0/3284222188 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7fe0c80845f0 con 0x7fe0d80b3aa0 2024-09-21T07:00:31.888 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:31.889 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:00:22.544759+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:00:18.869431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:00:19.879189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:00:31.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.888+0000 7fe0dcda1640 1 -- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe0b8078bc0 msgr2=0x7fe0b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:31.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.888+0000 7fe0dcda1640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe0b8078bc0 0x7fe0b807b0d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc006fd0 tx=0x7fe0cc008040 comp rx=0 tx=0).stop 2024-09-21T07:00:31.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.888+0000 7fe0dcda1640 1 -- 172.21.15.63:0/3284222188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d80b3aa0 msgr2=0x7fe0d80b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:31.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.888+0000 7fe0dcda1640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d80b3aa0 0x7fe0d80b6230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe0c802ab20 tx=0x7fe0c8004ac0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.889+0000 7fe0dcda1640 1 -- 172.21.15.63:0/3284222188 shutdown_connections 2024-09-21T07:00:31.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.889+0000 7fe0dcda1640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe0b8078bc0 0x7fe0b807b0d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.889+0000 7fe0dcda1640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d80b6770 0x7fe0d81591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.889+0000 7fe0dcda1640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0d80b9aa0 0x7fe0d80ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.889+0000 7fe0dcda1640 1 --2- 172.21.15.63:0/3284222188 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d80b3aa0 0x7fe0d80b6230 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:31.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.889+0000 7fe0dcda1640 1 -- 172.21.15.63:0/3284222188 >> 172.21.15.63:0/3284222188 conn(0x7fe0d80d45e0 msgr2=0x7fe0d80cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:31.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.889+0000 7fe0dcda1640 1 -- 172.21.15.63:0/3284222188 shutdown_connections 2024-09-21T07:00:31.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:31.889+0000 7fe0dcda1640 1 -- 172.21.15.63:0/3284222188 wait complete. 2024-09-21T07:00:31.902 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T07:00:31.902 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T07:00:31.905 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T07:00:31.906 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T07:00:31.906 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T07:00:31.906 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T07:00:31.907 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T07:00:31.907 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T07:00:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.134+0000 7f591740e640 1 -- 172.21.15.63:0/2756859276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59100b4da0 msgr2=0x7f591006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.134+0000 7f591740e640 1 --2- 172.21.15.63:0/2756859276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59100b4da0 0x7f591006f080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f591006fca0 tx=0x7f590802a6b0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.135+0000 7f591740e640 1 -- 172.21.15.63:0/2756859276 shutdown_connections 2024-09-21T07:00:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.135+0000 7f591740e640 1 --2- 172.21.15.63:0/2756859276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59100b4da0 0x7f591006f080 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.135+0000 7f591740e640 1 --2- 172.21.15.63:0/2756859276 >> v2:172.21.15.71:3300/0 conn(0x7f59100b35c0 0x7f5910155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.135+0000 7f591740e640 1 -- 172.21.15.63:0/2756859276 >> 172.21.15.63:0/2756859276 conn(0x7f59100b21c0 msgr2=0x7f59100b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.135+0000 7fea66c25640 1 -- 172.21.15.63:0/3651463159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea600b3aa0 msgr2=0x7fea600d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.135+0000 7f591740e640 1 -- 172.21.15.63:0/2756859276 shutdown_connections 2024-09-21T07:00:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.135+0000 7f591740e640 1 -- 172.21.15.63:0/2756859276 wait complete. 2024-09-21T07:00:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.135+0000 7fea66c25640 1 --2- 172.21.15.63:0/3651463159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea600b3aa0 0x7fea600d2fd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fea600b3eb0 tx=0x7fea54032cc0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7fea66c25640 1 -- 172.21.15.63:0/3651463159 shutdown_connections 2024-09-21T07:00:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7fea66c25640 1 --2- 172.21.15.63:0/3651463159 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea6008c960 0x7fea600d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7fea66c25640 1 --2- 172.21.15.63:0/3651463159 >> v2:172.21.15.71:3300/0 conn(0x7fea600b9aa0 0x7fea600d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7fea66c25640 1 --2- 172.21.15.63:0/3651463159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea600b3aa0 0x7fea600d2fd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7fea66c25640 1 -- 172.21.15.63:0/3651463159 >> 172.21.15.63:0/3651463159 conn(0x7fea600d45e0 msgr2=0x7fea600d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f128087c640 1 -- 172.21.15.63:0/255349293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1274005cb0 msgr2=0x7f1274036430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f128087c640 1 --2- 172.21.15.63:0/255349293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1274005cb0 0x7f1274036430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f127400ca70 tx=0x7f127002b1d0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7fea66c25640 1 -- 172.21.15.63:0/3651463159 shutdown_connections 2024-09-21T07:00:32.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f128087c640 1 -- 172.21.15.63:0/255349293 shutdown_connections 2024-09-21T07:00:32.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f128087c640 1 --2- 172.21.15.63:0/255349293 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1274036970 0x7f127401c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f128087c640 1 --2- 172.21.15.63:0/255349293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1274005cb0 0x7f1274036430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f128087c640 1 --2- 172.21.15.63:0/255349293 >> v2:172.21.15.71:3300/0 conn(0x7f1274009ba0 0x7f12740df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f128087c640 1 -- 172.21.15.63:0/255349293 >> 172.21.15.63:0/255349293 conn(0x7f1274051420 msgr2=0x7f1274051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7fea66c25640 1 -- 172.21.15.63:0/3651463159 wait complete. 2024-09-21T07:00:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f8bb69a8640 1 -- 172.21.15.63:0/3656471902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bb015bdd0 msgr2=0x7f8bb00d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f8bb69a8640 1 --2- 172.21.15.63:0/3656471902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bb015bdd0 0x7f8bb00d03e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009830 tx=0x7f8ba402a4b0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f8bb69a8640 1 -- 172.21.15.63:0/3656471902 shutdown_connections 2024-09-21T07:00:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f8bb69a8640 1 --2- 172.21.15.63:0/3656471902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bb015bdd0 0x7f8bb00d03e0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009830 tx=0x7f8ba402a4b0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f8bb69a8640 1 -- 172.21.15.63:0/3656471902 >> 172.21.15.63:0/3656471902 conn(0x7f8bb006cf90 msgr2=0x7f8bb006d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f128087c640 1 -- 172.21.15.63:0/255349293 shutdown_connections 2024-09-21T07:00:32.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f128087c640 1 -- 172.21.15.63:0/255349293 wait complete. 2024-09-21T07:00:32.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f8bb69a8640 1 -- 172.21.15.63:0/3656471902 shutdown_connections 2024-09-21T07:00:32.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.136+0000 7f8bb69a8640 1 -- 172.21.15.63:0/3656471902 wait complete. 2024-09-21T07:00:32.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.137+0000 7fb518700640 1 -- 172.21.15.63:0/4138284650 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb51015eb10 msgr2=0x7fb5100ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.137+0000 7fb518700640 1 --2- 172.21.15.63:0/4138284650 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb51015eb10 0x7fb5100ccbd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb5100cfb60 tx=0x7fb50802b860 comp rx=0 tx=0).stop 2024-09-21T07:00:32.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.137+0000 7f4597520640 1 -- 172.21.15.63:0/1406585321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459006fd90 msgr2=0x7f45900701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.137+0000 7fb518700640 1 -- 172.21.15.63:0/4138284650 shutdown_connections 2024-09-21T07:00:32.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.137+0000 7fb518700640 1 --2- 172.21.15.63:0/4138284650 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb51015eb10 0x7fb5100ccbd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.137+0000 7fb518700640 1 --2- 172.21.15.63:0/4138284650 >> v2:172.21.15.63:3300/0 conn(0x7fb5100af410 0x7fb51015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.137+0000 7fb518700640 1 --2- 172.21.15.63:0/4138284650 >> v2:172.21.15.71:3300/0 conn(0x7fb5100710b0 0x7fb5100709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.137+0000 7fb518700640 1 -- 172.21.15.63:0/4138284650 >> 172.21.15.63:0/4138284650 conn(0x7fb51006d3e0 msgr2=0x7fb5100b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.137+0000 7f4597520640 1 --2- 172.21.15.63:0/1406585321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459006fd90 0x7f45900701a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f458c005fd0 tx=0x7f458c02a5d0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7fb518700640 1 -- 172.21.15.63:0/4138284650 shutdown_connections 2024-09-21T07:00:32.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7f727ae6c640 1 -- 172.21.15.63:0/3422714035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72600050c0 msgr2=0x7f726000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7f727ae6c640 1 --2- 172.21.15.63:0/3422714035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72600050c0 0x7f726000b9c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7274051d10 tx=0x7f7260005830 comp rx=0 tx=0).stop 2024-09-21T07:00:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7f591740e640 1 Processor -- start 2024-09-21T07:00:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7f4597520640 1 -- 172.21.15.63:0/1406585321 shutdown_connections 2024-09-21T07:00:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7f4597520640 1 --2- 172.21.15.63:0/1406585321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459006fd90 0x7f45900701a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7f4597520640 1 -- 172.21.15.63:0/1406585321 >> 172.21.15.63:0/1406585321 conn(0x7f45900d0000 msgr2=0x7f45900d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7f4597520640 1 -- 172.21.15.63:0/1406585321 shutdown_connections 2024-09-21T07:00:32.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7fb518700640 1 -- 172.21.15.63:0/4138284650 wait complete. 2024-09-21T07:00:32.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7f727ae6c640 1 -- 172.21.15.63:0/3422714035 shutdown_connections 2024-09-21T07:00:32.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7f727ae6c640 1 --2- 172.21.15.63:0/3422714035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72600050c0 0x7f726000b9c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7f727ae6c640 1 -- 172.21.15.63:0/3422714035 >> 172.21.15.63:0/3422714035 conn(0x7f726c01eac0 msgr2=0x7f726c03a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7fd61f070640 1 -- 172.21.15.63:0/1714320184 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6180ce370 msgr2=0x7fd61815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7fd61f070640 1 --2- 172.21.15.63:0/1714320184 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6180ce370 0x7fd61815d5c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd604005fd0 tx=0x7fd604032aa0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7fd61f070640 1 -- 172.21.15.63:0/1714320184 shutdown_connections 2024-09-21T07:00:32.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.139+0000 7fd61f070640 1 --2- 172.21.15.63:0/1714320184 >> v2:172.21.15.71:3300/0 conn(0x7fd6180d07a0 0x7fd61806cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.139+0000 7fd61f070640 1 --2- 172.21.15.63:0/1714320184 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6180ce370 0x7fd61815d5c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.139+0000 7fd61f070640 1 -- 172.21.15.63:0/1714320184 >> 172.21.15.63:0/1714320184 conn(0x7fd6180b2f30 msgr2=0x7fd6180b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.139+0000 7fd61f070640 1 -- 172.21.15.63:0/1714320184 shutdown_connections 2024-09-21T07:00:32.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.139+0000 7fea66c25640 1 Processor -- start 2024-09-21T07:00:32.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.139+0000 7fea66c25640 1 -- start start 2024-09-21T07:00:32.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7f591740e640 1 -- start start 2024-09-21T07:00:32.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.139+0000 7f128087c640 1 Processor -- start 2024-09-21T07:00:32.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.139+0000 7f8bb69a8640 1 Processor -- start 2024-09-21T07:00:32.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.139+0000 7f8bb69a8640 1 -- start start 2024-09-21T07:00:32.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.140+0000 7f128087c640 1 -- start start 2024-09-21T07:00:32.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.140+0000 7f727ae6c640 1 -- 172.21.15.63:0/3422714035 shutdown_connections 2024-09-21T07:00:32.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.139+0000 7fd61f070640 1 -- 172.21.15.63:0/1714320184 wait complete. 2024-09-21T07:00:32.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.140+0000 7f727ae6c640 1 -- 172.21.15.63:0/3422714035 wait complete. 2024-09-21T07:00:32.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.140+0000 7fb518700640 1 Processor -- start 2024-09-21T07:00:32.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.141+0000 7f591740e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59100b35c0 0x7f5910160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.141+0000 7f591740e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f59100b4da0 0x7f591014ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.141+0000 7f591740e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59100b51b0 0x7f5910151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.141+0000 7f591740e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f59100708b0 con 0x7f59100b35c0 2024-09-21T07:00:32.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.141+0000 7f591740e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f591006f970 con 0x7f59100b51b0 2024-09-21T07:00:32.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.141+0000 7f591740e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5910070a30 con 0x7f59100b4da0 2024-09-21T07:00:32.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.141+0000 7f59159ab640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59100b51b0 0x7f5910151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.141+0000 7f59159ab640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59100b51b0 0x7f5910151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:56200/0 (socket says 172.21.15.63:56200) 2024-09-21T07:00:32.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.141+0000 7f59159ab640 1 -- 172.21.15.63:0/904267074 learned_addr learned my addr 172.21.15.63:0/904267074 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.141+0000 7f59149a9640 1 --2- 172.21.15.63:0/904267074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f59100b4da0 0x7f591014ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7fea66c25640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea6008c960 0x7fea600b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f8bb69a8640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8bb0074380 0x7f8bb013c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7fea66c25640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea600b3aa0 0x7fea60151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7fea66c25640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea600b9aa0 0x7fea600c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7fea66c25640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fea6006edd0 con 0x7fea600b3aa0 2024-09-21T07:00:32.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7fea66c25640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea6006ec50 con 0x7fea600b9aa0 2024-09-21T07:00:32.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f8bb69a8640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bb00d0920 0x7f8bb00ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f59149a9640 1 -- 172.21.15.63:0/904267074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59100b51b0 msgr2=0x7f5910151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f59149a9640 1 --2- 172.21.15.63:0/904267074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59100b51b0 0x7f5910151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f59149a9640 1 -- 172.21.15.63:0/904267074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59100b35c0 msgr2=0x7f5910160ec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:00:32.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f59149a9640 1 --2- 172.21.15.63:0/904267074 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59100b35c0 0x7f5910160ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f59149a9640 1 -- 172.21.15.63:0/904267074 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59101fa0c0 con 0x7f59100b4da0 2024-09-21T07:00:32.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7fea66c25640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fea6006ef50 con 0x7fea6008c960 2024-09-21T07:00:32.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f128087c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1274005cb0 0x7f12740e97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f8bb69a8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00acf30 0x7f8bb00b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f128087c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1274009ba0 0x7f12740e5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.138+0000 7f4597520640 1 -- 172.21.15.63:0/1406585321 wait complete. 2024-09-21T07:00:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.141+0000 7f4597520640 1 Processor -- start 2024-09-21T07:00:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.141+0000 7f4597520640 1 -- start start 2024-09-21T07:00:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f8bb69a8640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb0074e60 con 0x7f8bb00acf30 2024-09-21T07:00:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f8bb69a8640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb0071030 con 0x7f8bb00d0920 2024-09-21T07:00:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f8bb69a8640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb00b3a90 con 0x7f8bb0074380 2024-09-21T07:00:32.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f128087c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1274036970 0x7f127417b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7fea5ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea600b3aa0 0x7fea60151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7fea5ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea600b3aa0 0x7fea60151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36826/0 (socket says 172.21.15.63:36826) 2024-09-21T07:00:32.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7fea5ffff640 1 -- 172.21.15.63:0/1114824657 learned_addr learned my addr 172.21.15.63:0/1114824657 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f8baf7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bb00d0920 0x7f8bb00ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f8bb4f45640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00acf30 0x7f8bb00b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f127affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1274009ba0 0x7f12740e5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f127affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1274009ba0 0x7f12740e5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:56224/0 (socket says 172.21.15.63:56224) 2024-09-21T07:00:32.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f127affd640 1 -- 172.21.15.63:0/2118857172 learned_addr learned my addr 172.21.15.63:0/2118857172 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f127bfff640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1274036970 0x7f127417b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f128087c640 1 -- 172.21.15.63:0/2118857172 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f127400bdb0 con 0x7f1274005cb0 2024-09-21T07:00:32.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f128087c640 1 -- 172.21.15.63:0/2118857172 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f127400bc30 con 0x7f1274009ba0 2024-09-21T07:00:32.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f128087c640 1 -- 172.21.15.63:0/2118857172 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f127401caf0 con 0x7f1274036970 2024-09-21T07:00:32.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f8baffff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8bb0074380 0x7f8bb013c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f8bb4f45640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00acf30 0x7f8bb00b2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36842/0 (socket says 172.21.15.63:36842) 2024-09-21T07:00:32.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f8bb4f45640 1 -- 172.21.15.63:0/2735284558 learned_addr learned my addr 172.21.15.63:0/2735284558 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.142+0000 7f8baf7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bb00d0920 0x7f8bb00ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:56220/0 (socket says 172.21.15.63:56220) 2024-09-21T07:00:32.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f59149a9640 1 --2- 172.21.15.63:0/904267074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f59100b4da0 0x7f591014ed40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5908030000 tx=0x7f5908008b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fd61f070640 1 Processor -- start 2024-09-21T07:00:32.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fd61f070640 1 -- start start 2024-09-21T07:00:32.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fea5ffff640 1 -- 172.21.15.63:0/1114824657 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea6008c960 msgr2=0x7fea600b6530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:00:32.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fea5ffff640 1 --2- 172.21.15.63:0/1114824657 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fea6008c960 0x7fea600b6530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fea5ffff640 1 -- 172.21.15.63:0/1114824657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea600b9aa0 msgr2=0x7fea600c7f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T07:00:32.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fea5ffff640 1 --2- 172.21.15.63:0/1114824657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea600b9aa0 0x7fea600c7f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fea5ffff640 1 -- 172.21.15.63:0/1114824657 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea600ccfc0 con 0x7fea600b3aa0 2024-09-21T07:00:32.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.141+0000 7fb518700640 1 -- start start 2024-09-21T07:00:32.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f127b7fe640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1274005cb0 0x7f12740e97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f127bfff640 1 -- 172.21.15.63:0/2118857172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1274009ba0 msgr2=0x7f12740e5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f127bfff640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1274009ba0 0x7f12740e5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f127bfff640 1 -- 172.21.15.63:0/2118857172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1274005cb0 msgr2=0x7f12740e97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fea5ffff640 1 --2- 172.21.15.63:0/1114824657 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea600b3aa0 0x7fea60151b10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fea5800eb30 tx=0x7fea5800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fb518700640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5100710b0 0x7fb5100afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f5905ffb640 1 -- 172.21.15.63:0/904267074 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5908036050 con 0x7f59100b4da0 2024-09-21T07:00:32.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f727ae6c640 1 Processor -- start 2024-09-21T07:00:32.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f127bfff640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1274005cb0 0x7f12740e97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f127bfff640 1 -- 172.21.15.63:0/2118857172 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1274021a50 con 0x7f1274036970 2024-09-21T07:00:32.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fb518700640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5100af410 0x7fb5101fd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f727ae6c640 1 -- start start 2024-09-21T07:00:32.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fb518700640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb51015eb10 0x7fb5101fc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fb518700640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb5100ce8d0 con 0x7fb51015eb10 2024-09-21T07:00:32.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fb518700640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb5100ce750 con 0x7fb5100710b0 2024-09-21T07:00:32.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7fb518700640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb5100cea50 con 0x7fb5100af410 2024-09-21T07:00:32.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f4597520640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459006fd90 0x7f4590146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f4597520640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4590070eb0 0x7f45900cee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f4597520640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45900b32f0 0x7f45900cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7fb51649c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5100710b0 0x7fb5100afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7fb515c9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5100af410 0x7fb5101fd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f127b7fe640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1274005cb0 0x7f12740e97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:00:32.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7fb515c9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5100af410 0x7fb5101fd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:58532/0 (socket says 172.21.15.63:58532) 2024-09-21T07:00:32.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7fb515c9b640 1 -- 172.21.15.63:0/3747887251 learned_addr learned my addr 172.21.15.63:0/3747887251 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7fea5d7fa640 1 -- 172.21.15.63:0/1114824657 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58010430 con 0x7fea600b3aa0 2024-09-21T07:00:32.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7fea5d7fa640 1 -- 172.21.15.63:0/1114824657 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea580105d0 con 0x7fea600b3aa0 2024-09-21T07:00:32.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f459651e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459006fd90 0x7f4590146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f459651e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459006fd90 0x7f4590146220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:56238/0 (socket says 172.21.15.63:56238) 2024-09-21T07:00:32.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f4595d1d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4590070eb0 0x7f45900cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f4595d1d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4590070eb0 0x7f45900cee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:58534/0 (socket says 172.21.15.63:58534) 2024-09-21T07:00:32.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f459651e640 1 -- 172.21.15.63:0/2866739076 learned_addr learned my addr 172.21.15.63:0/2866739076 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f8baf7fe640 1 -- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8bb0074380 msgr2=0x7f8bb013c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f8baf7fe640 1 --2- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f8bb0074380 0x7f8bb013c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f8baf7fe640 1 -- 172.21.15.63:0/2735284558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00acf30 msgr2=0x7f8bb00b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f8baf7fe640 1 --2- 172.21.15.63:0/2735284558 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8bb00acf30 0x7f8bb00b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f8baf7fe640 1 -- 172.21.15.63:0/2735284558 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb01fe4a0 con 0x7f8bb00d0920 2024-09-21T07:00:32.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.143+0000 7f8baf7fe640 1 --2- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bb00d0920 0x7f8bb00ac9f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00c6b0 tx=0x7f8b9c00cb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f8bacff9640 1 -- 172.21.15.63:0/2735284558 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c017070 con 0x7f8bb00d0920 2024-09-21T07:00:32.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f591740e640 1 -- 172.21.15.63:0/904267074 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59101617c0 con 0x7f59100b4da0 2024-09-21T07:00:32.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f591740e640 1 -- 172.21.15.63:0/904267074 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f59101fbc60 con 0x7f59100b4da0 2024-09-21T07:00:32.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7fea5d7fa640 1 -- 172.21.15.63:0/1114824657 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58010a20 con 0x7fea600b3aa0 2024-09-21T07:00:32.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f459015b360 con 0x7f45900b32f0 2024-09-21T07:00:32.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f459015b1e0 con 0x7f459006fd90 2024-09-21T07:00:32.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f459015b4e0 con 0x7f4590070eb0 2024-09-21T07:00:32.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f8bacff9640 1 -- 172.21.15.63:0/2735284558 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b9c005360 con 0x7f8bb00d0920 2024-09-21T07:00:32.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f8bacff9640 1 -- 172.21.15.63:0/2735284558 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00a8a0 con 0x7f8bb00d0920 2024-09-21T07:00:32.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f8bb69a8640 1 -- 172.21.15.63:0/2735284558 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb013ec50 con 0x7f8bb00d0920 2024-09-21T07:00:32.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f8bb69a8640 1 -- 172.21.15.63:0/2735284558 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb013f210 con 0x7f8bb00d0920 2024-09-21T07:00:32.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7fea66c25640 1 -- 172.21.15.63:0/1114824657 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea600cd2a0 con 0x7fea600b3aa0 2024-09-21T07:00:32.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f5905ffb640 1 -- 172.21.15.63:0/904267074 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5908042070 con 0x7f59100b4da0 2024-09-21T07:00:32.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7f5905ffb640 1 -- 172.21.15.63:0/904267074 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5908004610 con 0x7f59100b4da0 2024-09-21T07:00:32.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.144+0000 7fea66c25640 1 -- 172.21.15.63:0/1114824657 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea600cd860 con 0x7fea600b3aa0 2024-09-21T07:00:32.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.145+0000 7f127bfff640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1274036970 0x7f127417b470 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f127c06a350 tx=0x7f127c0519a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.145+0000 7f4596d1f640 1 --2- 172.21.15.63:0/2866739076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45900b32f0 0x7f45900cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.145+0000 7f4596d1f640 1 -- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4590070eb0 msgr2=0x7f45900cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.145+0000 7f4596d1f640 1 --2- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4590070eb0 0x7f45900cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.145+0000 7f4596d1f640 1 -- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459006fd90 msgr2=0x7f4590146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.145+0000 7f4596d1f640 1 --2- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459006fd90 0x7f4590146220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.145+0000 7f4596d1f640 1 -- 172.21.15.63:0/2866739076 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4590146940 con 0x7f45900b32f0 2024-09-21T07:00:32.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fea66c25640 1 -- 172.21.15.63:0/1114824657 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fea600d2fd0 con 0x7fea600b3aa0 2024-09-21T07:00:32.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f4596d1f640 1 --2- 172.21.15.63:0/2866739076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45900b32f0 0x7f45900cf390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4588009ef0 tx=0x7f458800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f1267fff640 1 -- 172.21.15.63:0/2118857172 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c090070 con 0x7f1274036970 2024-09-21T07:00:32.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.145+0000 7fb51649c640 1 -- 172.21.15.63:0/3747887251 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5100af410 msgr2=0x7fb5101fd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.145+0000 7fb51649c640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb5100af410 0x7fb5101fd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.145+0000 7fb51649c640 1 -- 172.21.15.63:0/3747887251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb51015eb10 msgr2=0x7fb5101fc640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:00:32.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f1267fff640 1 -- 172.21.15.63:0/2118857172 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f127c0729e0 con 0x7f1274036970 2024-09-21T07:00:32.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fd61f070640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6180ce370 0x7fd61813cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fd61f070640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6180d07a0 0x7fd618154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fd61f070640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6180d0bb0 0x7fd618141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fd61f070640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd618074540 con 0x7fd6180d0bb0 2024-09-21T07:00:32.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fd61f070640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd61806d6c0 con 0x7fd6180d07a0 2024-09-21T07:00:32.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fd61f070640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd6180746c0 con 0x7fd6180ce370 2024-09-21T07:00:32.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f128087c640 1 -- 172.21.15.63:0/2118857172 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1274021d30 con 0x7f1274036970 2024-09-21T07:00:32.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fb516c9d640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb51015eb10 0x7fb5101fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f128087c640 1 -- 172.21.15.63:0/2118857172 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f12740222f0 con 0x7f1274036970 2024-09-21T07:00:32.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fb51649c640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb51015eb10 0x7fb5101fc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fb51649c640 1 -- 172.21.15.63:0/3747887251 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5100b1fe0 con 0x7fb5100710b0 2024-09-21T07:00:32.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fb516c9d640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb51015eb10 0x7fb5101fc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:00:32.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7fb51649c640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5100710b0 0x7fb5100afcc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00e680 tx=0x7fb50c00eb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f4582ffd640 1 -- 172.21.15.63:0/2866739076 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458801a7d0 con 0x7f45900b32f0 2024-09-21T07:00:32.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f4582ffd640 1 -- 172.21.15.63:0/2866739076 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4588020070 con 0x7f45900b32f0 2024-09-21T07:00:32.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fd61d60d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6180d0bb0 0x7fd618141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fd61d60d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6180d0bb0 0x7fd618141fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36872/0 (socket says 172.21.15.63:36872) 2024-09-21T07:00:32.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fd61d60d640 1 -- 172.21.15.63:0/167466416 learned_addr learned my addr 172.21.15.63:0/167466416 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7fd61ce0c640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6180ce370 0x7fd61813cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f727ae6c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72600050c0 0x7f726c04f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f727ae6c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f726c0d7470 0x7f726c04fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f7279e6a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72600050c0 0x7f726c04f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f7279e6a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72600050c0 0x7f726c04f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:58556/0 (socket says 172.21.15.63:58556) 2024-09-21T07:00:32.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f7279e6a640 1 -- 172.21.15.63:0/231825326 learned_addr learned my addr 172.21.15.63:0/231825326 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f727ae6c640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f726c034600 0x7f726c178820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f726c0e4870 con 0x7f726c034600 2024-09-21T07:00:32.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7f727a66b640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f726c034600 0x7f726c178820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7fd61ce0c640 1 -- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6180d07a0 msgr2=0x7fd618154ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T07:00:32.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7fd61ce0c640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd6180d07a0 0x7fd618154ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7fd61ce0c640 1 -- 172.21.15.63:0/167466416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6180d0bb0 msgr2=0x7fd618141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7fd61ce0c640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6180d0bb0 0x7fd618141fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7fd61ce0c640 1 -- 172.21.15.63:0/167466416 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd618155420 con 0x7fd6180ce370 2024-09-21T07:00:32.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7fd61d60d640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6180d0bb0 0x7fd618141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:32.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.146+0000 7f7279669640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f726c0d7470 0x7f726c04fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7f4582ffd640 1 -- 172.21.15.63:0/2866739076 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458801ad40 con 0x7f45900b32f0 2024-09-21T07:00:32.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7f591740e640 1 -- 172.21.15.63:0/904267074 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f58f0001030 con 0x7f59100b4da0 2024-09-21T07:00:32.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f726c0e46f0 con 0x7f726c0d7470 2024-09-21T07:00:32.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f726c0351a0 con 0x7f72600050c0 2024-09-21T07:00:32.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459009aae0 con 0x7f45900b32f0 2024-09-21T07:00:32.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7f8bacff9640 1 -- 172.21.15.63:0/2735284558 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b9c01a070 con 0x7f8bb00d0920 2024-09-21T07:00:32.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7f1267fff640 1 -- 172.21.15.63:0/2118857172 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c072e10 con 0x7f1274036970 2024-09-21T07:00:32.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7f1265ffb640 1 -- 172.21.15.63:0/2118857172 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f125c001030 con 0x7f1274036970 2024-09-21T07:00:32.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7fea5d7fa640 1 -- 172.21.15.63:0/1114824657 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea58010bc0 con 0x7fea600b3aa0 2024-09-21T07:00:32.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f459009b060 con 0x7f45900b32f0 2024-09-21T07:00:32.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.147+0000 7fb506ffd640 1 -- 172.21.15.63:0/3747887251 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c00cab0 con 0x7fb5100710b0 2024-09-21T07:00:32.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7fb506ffd640 1 -- 172.21.15.63:0/3747887251 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb50c00cd40 con 0x7fb5100710b0 2024-09-21T07:00:32.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7fb506ffd640 1 -- 172.21.15.63:0/3747887251 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50c010690 con 0x7fb5100710b0 2024-09-21T07:00:32.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7fd61ce0c640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6180ce370 0x7fd61813cfe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd61815d2b0 tx=0x7fd60400ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7fd6157fa640 1 -- 172.21.15.63:0/167466416 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60403a040 con 0x7fd6180ce370 2024-09-21T07:00:32.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7fd6157fa640 1 -- 172.21.15.63:0/167466416 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd604037a40 con 0x7fd6180ce370 2024-09-21T07:00:32.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7fd6157fa640 1 -- 172.21.15.63:0/167466416 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604004020 con 0x7fd6180ce370 2024-09-21T07:00:32.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7f8bacff9640 1 --2- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8b94078c60 0x7f8b9407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7f7279e6a640 1 -- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f726c0d7470 msgr2=0x7f726c04fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7f7279e6a640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f726c0d7470 0x7f726c04fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7f7279e6a640 1 -- 172.21.15.63:0/231825326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f726c034600 msgr2=0x7f726c178820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7f7279e6a640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f726c034600 0x7f726c178820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7f7279e6a640 1 -- 172.21.15.63:0/231825326 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c050370 con 0x7f72600050c0 2024-09-21T07:00:32.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7f8bb69a8640 1 -- 172.21.15.63:0/2735284558 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b90001030 con 0x7f8bb00d0920 2024-09-21T07:00:32.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7fea5d7fa640 1 --2- 172.21.15.63:0/1114824657 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fea4c078c90 0x7fea4c07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7fea5d7fa640 1 -- 172.21.15.63:0/1114824657 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fea5809c690 con 0x7fea600b3aa0 2024-09-21T07:00:32.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7f7279e6a640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72600050c0 0x7f726c04f510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f727000e740 tx=0x7f727000ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7f8bacff9640 1 -- 172.21.15.63:0/2735284558 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8b9c09a120 con 0x7f8bb00d0920 2024-09-21T07:00:32.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7f8bacff9640 1 --2- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] conn(0x7f8b94080eb0 0x7f8b94083300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7fea5d7fa640 1 --2- 172.21.15.63:0/1114824657 >> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] conn(0x7fea4c080f60 0x7fea4c0833b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7fea5d7fa640 1 -- 172.21.15.63:0/1114824657 --> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea4c083a80 con 0x7fea4c080f60 2024-09-21T07:00:32.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7fea5d7fa640 1 -- 172.21.15.63:0/1114824657 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fea5809ca80 con 0x7fea600b3aa0 2024-09-21T07:00:32.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7fea649c1640 1 --2- 172.21.15.63:0/1114824657 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fea4c078c90 0x7fea4c07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7f8bacff9640 1 -- 172.21.15.63:0/2735284558 --> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b9c01de80 con 0x7f8b94080eb0 2024-09-21T07:00:32.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7f8bacff9640 1 -- 172.21.15.63:0/2735284558 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f8b9c021020 con 0x7f8bb00d0920 2024-09-21T07:00:32.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7f8bb4f45640 1 --2- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] conn(0x7f8b94080eb0 0x7f8b94083300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7f1267fff640 1 -- 172.21.15.63:0/2118857172 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f127c093070 con 0x7f1274036970 2024-09-21T07:00:32.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7fd61f070640 1 -- 172.21.15.63:0/167466416 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd618153e40 con 0x7fd6180ce370 2024-09-21T07:00:32.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.150+0000 7fd61f070640 1 -- 172.21.15.63:0/167466416 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd618154400 con 0x7fd6180ce370 2024-09-21T07:00:32.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.150+0000 7fea651c2640 1 --2- 172.21.15.63:0/1114824657 >> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] conn(0x7fea4c080f60 0x7fea4c0833b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7fb518700640 1 -- 172.21.15.63:0/3747887251 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5100c5680 con 0x7fb5100710b0 2024-09-21T07:00:32.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7fb518700640 1 -- 172.21.15.63:0/3747887251 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5100c5c40 con 0x7fb5100710b0 2024-09-21T07:00:32.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.150+0000 7f1267fff640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1260078c90 0x7f126007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.148+0000 7f5905ffb640 1 -- 172.21.15.63:0/904267074 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f590803d450 con 0x7f59100b4da0 2024-09-21T07:00:32.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7f5905ffb640 1 --2- 172.21.15.63:0/904267074 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f58f4078c60 0x7f58f407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7f5905ffb640 1 -- 172.21.15.63:0/904267074 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f59080bb8e0 con 0x7f59100b4da0 2024-09-21T07:00:32.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.149+0000 7f5905ffb640 1 --2- 172.21.15.63:0/904267074 >> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] conn(0x7f58f4080e50 0x7f58f40832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.150+0000 7f59159ab640 1 --2- 172.21.15.63:0/904267074 >> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] conn(0x7f58f4080e50 0x7f58f40832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.150+0000 7fb518700640 1 -- 172.21.15.63:0/3747887251 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb51015e5d0 con 0x7fb5100710b0 2024-09-21T07:00:32.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.150+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f459009b860 con 0x7f45900b32f0 2024-09-21T07:00:32.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.150+0000 7fea651c2640 1 --2- 172.21.15.63:0/1114824657 >> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] conn(0x7fea4c080f60 0x7fea4c0833b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f1267fff640 1 -- 172.21.15.63:0/2118857172 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f127c116140 con 0x7f1274036970 2024-09-21T07:00:32.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f726a7fc640 1 -- 172.21.15.63:0/231825326 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270005460 con 0x7f72600050c0 2024-09-21T07:00:32.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f127b7fe640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1260078c90 0x7f126007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f726a7fc640 1 -- 172.21.15.63:0/231825326 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7270005600 con 0x7f72600050c0 2024-09-21T07:00:32.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7fd61f070640 1 -- 172.21.15.63:0/167466416 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd618074bb0 con 0x7fd6180ce370 2024-09-21T07:00:32.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f59159ab640 1 --2- 172.21.15.63:0/904267074 >> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] conn(0x7f58f4080e50 0x7f58f40832a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f1267fff640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] conn(0x7f1260080f60 0x7f12600833b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f5905ffb640 1 -- 172.21.15.63:0/904267074 --> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f590802eec0 con 0x7f58f4080e50 2024-09-21T07:00:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f5905ffb640 1 -- 172.21.15.63:0/904267074 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f590807fda0 con 0x7f59100b4da0 2024-09-21T07:00:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f59151aa640 1 --2- 172.21.15.63:0/904267074 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f58f4078c60 0x7f58f407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f1267fff640 1 -- 172.21.15.63:0/2118857172 --> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f127c06fe50 con 0x7f1260080f60 2024-09-21T07:00:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f1267fff640 1 -- 172.21.15.63:0/2118857172 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f127c11d050 con 0x7f1274036970 2024-09-21T07:00:32.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f4582ffd640 1 -- 172.21.15.63:0/2866739076 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4588025460 con 0x7f45900b32f0 2024-09-21T07:00:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.150+0000 7f8baffff640 1 --2- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8b94078c60 0x7f8b9407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f8baffff640 1 --2- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8b94078c60 0x7f8b9407b170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4034000 tx=0x7f8ba4004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f726a7fc640 1 -- 172.21.15.63:0/231825326 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727000cab0 con 0x7f72600050c0 2024-09-21T07:00:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c0e0580 con 0x7f72600050c0 2024-09-21T07:00:32.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c0e0b40 con 0x7f72600050c0 2024-09-21T07:00:32.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.152+0000 7f127b7fe640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1260078c90 0x7f126007b1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f126800a7f0 tx=0x7f1268008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.151+0000 7fea649c1640 1 --2- 172.21.15.63:0/1114824657 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fea4c078c90 0x7fea4c07b1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fea5403d000 tx=0x7fea54004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.152+0000 7f127affd640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] conn(0x7f1260080f60 0x7f12600833b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.152+0000 7f4582ffd640 1 --2- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4574078c10 0x7f457407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.152+0000 7f459651e640 1 --2- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4574078c10 0x7f457407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.152+0000 7f5905ffb640 1 -- 172.21.15.63:0/904267074 <== osd.0 v2:172.21.15.63:6800/1037303619 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f590802eec0 con 0x7f58f4080e50 2024-09-21T07:00:32.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.152+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f726c0e0d10 con 0x7f72600050c0 2024-09-21T07:00:32.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.152+0000 7f4582ffd640 1 -- 172.21.15.63:0/2866739076 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f45880a3d70 con 0x7f45900b32f0 2024-09-21T07:00:32.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.152+0000 7f4582ffd640 1 --2- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] conn(0x7f4574080ee0 0x7f4574083330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.152+0000 7fd6157fa640 1 -- 172.21.15.63:0/167466416 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd604034040 con 0x7fd6180ce370 2024-09-21T07:00:32.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.153+0000 7f4582ffd640 1 -- 172.21.15.63:0/2866739076 --> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4574083a00 con 0x7f4574080ee0 2024-09-21T07:00:32.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.153+0000 7f4582ffd640 1 -- 172.21.15.63:0/2866739076 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f45880a64c0 con 0x7f45900b32f0 2024-09-21T07:00:32.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.153+0000 7f59151aa640 1 --2- 172.21.15.63:0/904267074 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f58f4078c60 0x7f58f407b170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f590c00a7e0 tx=0x7f590c005ae0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.153+0000 7f127affd640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] conn(0x7f1260080f60 0x7f12600833b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.153+0000 7fea5d7fa640 1 -- 172.21.15.63:0/1114824657 <== osd.2 v2:172.21.15.63:6823/115139768 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fea4c083a80 con 0x7fea4c080f60 2024-09-21T07:00:32.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.153+0000 7f4595d1d640 1 --2- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] conn(0x7f4574080ee0 0x7f4574083330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.153+0000 7f8bb4f45640 1 --2- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] conn(0x7f8b94080eb0 0x7f8b94083300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.153+0000 7f459651e640 1 --2- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4574078c10 0x7f457407b120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4584000f60 tx=0x7f4584009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.153+0000 7fb506ffd640 1 -- 172.21.15.63:0/3747887251 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb50c010830 con 0x7fb5100710b0 2024-09-21T07:00:32.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.153+0000 7f4595d1d640 1 --2- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] conn(0x7f4574080ee0 0x7f4574083330 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.153+0000 7fd6157fa640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd5fc078b90 0x7fd5fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.154+0000 7fd6157fa640 1 -- 172.21.15.63:0/167466416 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd6040c3500 con 0x7fd6180ce370 2024-09-21T07:00:32.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.154+0000 7f1267fff640 1 -- 172.21.15.63:0/2118857172 <== osd.1 v2:172.21.15.63:6808/2756858470 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f127c06fe50 con 0x7f1260080f60 2024-09-21T07:00:32.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.154+0000 7fd617fff640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd5fc078b90 0x7fd5fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.154+0000 7fd6157fa640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] conn(0x7fd5fc080e60 0x7fd5fc0832b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.154+0000 7fd6157fa640 1 -- 172.21.15.63:0/167466416 --> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd60400f400 con 0x7fd5fc080e60 2024-09-21T07:00:32.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.154+0000 7fd6157fa640 1 -- 172.21.15.63:0/167466416 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fd6040ca050 con 0x7fd6180ce370 2024-09-21T07:00:32.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.154+0000 7f8bacff9640 1 -- 172.21.15.63:0/2735284558 <== osd.5 v2:172.21.15.71:6819/3896443315 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b9c01de80 con 0x7f8b94080eb0 2024-09-21T07:00:32.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.154+0000 7f726a7fc640 1 -- 172.21.15.63:0/231825326 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f727000cc50 con 0x7f72600050c0 2024-09-21T07:00:32.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.154+0000 7fb506ffd640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb4f4078c90 0x7fb4f407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.154+0000 7fd61d60d640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] conn(0x7fd5fc080e60 0x7fd5fc0832b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.154+0000 7f4582ffd640 1 -- 172.21.15.63:0/2866739076 <== osd.4 v2:172.21.15.71:6802/3275296788 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4574083a00 con 0x7f4574080ee0 2024-09-21T07:00:32.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.154+0000 7fb506ffd640 1 -- 172.21.15.63:0/3747887251 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb50c09c0c0 con 0x7fb5100710b0 2024-09-21T07:00:32.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.154+0000 7fd617fff640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd5fc078b90 0x7fd5fc07b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd618155830 tx=0x7fd60c005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.155+0000 7fb506ffd640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] conn(0x7fb4f4080f60 0x7fb4f40833b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.155+0000 7f726a7fc640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7258078c60 0x7f725807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.155+0000 7fd61d60d640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] conn(0x7fd5fc080e60 0x7fd5fc0832b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.155+0000 7fb515c9b640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb4f4078c90 0x7fb4f407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.155+0000 7fb506ffd640 1 -- 172.21.15.63:0/3747887251 --> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb50c01bec0 con 0x7fb4f4080f60 2024-09-21T07:00:32.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.155+0000 7fb506ffd640 1 -- 172.21.15.63:0/3747887251 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fb50c09c4b0 con 0x7fb5100710b0 2024-09-21T07:00:32.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.155+0000 7fb516c9d640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] conn(0x7fb4f4080f60 0x7fb4f40833b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.155+0000 7f726a7fc640 1 -- 172.21.15.63:0/231825326 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f727009b7e0 con 0x7f72600050c0 2024-09-21T07:00:32.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.155+0000 7f7279669640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7258078c60 0x7f725807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.155+0000 7fb515c9b640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb4f4078c90 0x7fb4f407b1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb5100ba990 tx=0x7fb50000a300 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.155+0000 7f726a7fc640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] conn(0x7f7258080e50 0x7f72580832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.155+0000 7f726a7fc640 1 -- 172.21.15.63:0/231825326 --> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f727000be50 con 0x7f7258080e50 2024-09-21T07:00:32.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.155+0000 7f727a66b640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] conn(0x7f7258080e50 0x7f72580832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.156+0000 7fd6157fa640 1 -- 172.21.15.63:0/167466416 <== osd.6 v2:172.21.15.71:6810/3022228131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd60400f400 con 0x7fd5fc080e60 2024-09-21T07:00:32.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.156+0000 7f726a7fc640 1 -- 172.21.15.63:0/231825326 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f72700a2050 con 0x7f72600050c0 2024-09-21T07:00:32.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.156+0000 7fb516c9d640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] conn(0x7fb4f4080f60 0x7fb4f40833b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.156+0000 7f727a66b640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] conn(0x7f7258080e50 0x7f72580832a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.156+0000 7f7279669640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7258078c60 0x7f725807b170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f726c034f50 tx=0x7f7264009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.157+0000 7f726a7fc640 1 -- 172.21.15.63:0/231825326 <== osd.7 v2:172.21.15.71:6818/829212065 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f727000be50 con 0x7f7258080e50 2024-09-21T07:00:32.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.157+0000 7fb506ffd640 1 -- 172.21.15.63:0/3747887251 <== osd.3 v2:172.21.15.63:6816/1900864594 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb50c01bec0 con 0x7fb4f4080f60 2024-09-21T07:00:32.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.184+0000 7f1265ffb640 1 -- 172.21.15.63:0/2118857172 --> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f125c002dd0 con 0x7f1260080f60 2024-09-21T07:00:32.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.184+0000 7f1267fff640 1 -- 172.21.15.63:0/2118857172 <== osd.1 v2:172.21.15.63:6808/2756858470 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f125c002dd0 con 0x7f1260080f60 2024-09-21T07:00:32.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.184+0000 7fea66c25640 1 -- 172.21.15.63:0/1114824657 --> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fea600ccd70 con 0x7fea4c080f60 2024-09-21T07:00:32.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.185+0000 7fea5d7fa640 1 -- 172.21.15.63:0/1114824657 <== osd.2 v2:172.21.15.63:6823/115139768 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fea600ccd70 con 0x7fea4c080f60 2024-09-21T07:00:32.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.185+0000 7f8bb69a8640 1 -- 172.21.15.63:0/2735284558 --> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8b90002d50 con 0x7f8b94080eb0 2024-09-21T07:00:32.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.185+0000 7f128087c640 1 -- 172.21.15.63:0/2118857172 >> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] conn(0x7f1260080f60 msgr2=0x7f12600833b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.185+0000 7f128087c640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] conn(0x7f1260080f60 0x7f12600833b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.185+0000 7fea46ffd640 1 -- 172.21.15.63:0/1114824657 >> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] conn(0x7fea4c080f60 msgr2=0x7fea4c0833b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.185+0000 7fea46ffd640 1 --2- 172.21.15.63:0/1114824657 >> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] conn(0x7fea4c080f60 0x7fea4c0833b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7f591740e640 1 -- 172.21.15.63:0/904267074 --> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f58f0002dd0 con 0x7f58f4080e50 2024-09-21T07:00:32.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7fea46ffd640 1 -- 172.21.15.63:0/1114824657 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fea4c078c90 msgr2=0x7fea4c07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7fea46ffd640 1 --2- 172.21.15.63:0/1114824657 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fea4c078c90 0x7fea4c07b1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fea5403d000 tx=0x7fea54004730 comp rx=0 tx=0).stop 2024-09-21T07:00:32.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7fea46ffd640 1 -- 172.21.15.63:0/1114824657 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea600b3aa0 msgr2=0x7fea60151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7f8bacff9640 1 -- 172.21.15.63:0/2735284558 <== osd.5 v2:172.21.15.71:6819/3896443315 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8b90002d50 con 0x7f8b94080eb0 2024-09-21T07:00:32.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7f128087c640 1 -- 172.21.15.63:0/2118857172 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1260078c90 msgr2=0x7f126007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7f128087c640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1260078c90 0x7f126007b1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f126800a7f0 tx=0x7f1268008040 comp rx=0 tx=0).stop 2024-09-21T07:00:32.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7fea46ffd640 1 --2- 172.21.15.63:0/1114824657 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fea600b3aa0 0x7fea60151b10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fea5800eb30 tx=0x7fea5800c2d0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7f128087c640 1 -- 172.21.15.63:0/2118857172 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1274036970 msgr2=0x7f127417b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7f128087c640 1 --2- 172.21.15.63:0/2118857172 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1274036970 0x7f127417b470 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f127c06a350 tx=0x7f127c0519a0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7f127bfff640 1 -- 172.21.15.63:0/2118857172 reap_dead start 2024-09-21T07:00:32.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7f128087c640 1 -- 172.21.15.63:0/2118857172 shutdown_connections 2024-09-21T07:00:32.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7f128087c640 1 -- 172.21.15.63:0/2118857172 >> 172.21.15.63:0/2118857172 conn(0x7f1274051420 msgr2=0x7f12740e1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7f5905ffb640 1 -- 172.21.15.63:0/904267074 <== osd.0 v2:172.21.15.63:6800/1037303619 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f58f0002dd0 con 0x7f58f4080e50 2024-09-21T07:00:32.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7f128087c640 1 -- 172.21.15.63:0/2118857172 shutdown_connections 2024-09-21T07:00:32.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7f128087c640 1 -- 172.21.15.63:0/2118857172 wait complete. 2024-09-21T07:00:32.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7fea651c2640 1 -- 172.21.15.63:0/1114824657 reap_dead start 2024-09-21T07:00:32.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7fea46ffd640 1 -- 172.21.15.63:0/1114824657 shutdown_connections 2024-09-21T07:00:32.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7fea46ffd640 1 -- 172.21.15.63:0/1114824657 >> 172.21.15.63:0/1114824657 conn(0x7fea600d45e0 msgr2=0x7fea60161e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.186+0000 7f8bb69a8640 1 -- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] conn(0x7f8b94080eb0 msgr2=0x7f8b94083300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f8bb69a8640 1 --2- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] conn(0x7f8b94080eb0 0x7f8b94083300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7fea46ffd640 1 -- 172.21.15.63:0/1114824657 shutdown_connections 2024-09-21T07:00:32.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7fea46ffd640 1 -- 172.21.15.63:0/1114824657 wait complete. 2024-09-21T07:00:32.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f8bb69a8640 1 -- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8b94078c60 msgr2=0x7f8b9407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f8bb69a8640 1 --2- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8b94078c60 0x7f8b9407b170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4034000 tx=0x7f8ba4004730 comp rx=0 tx=0).stop 2024-09-21T07:00:32.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f8bb69a8640 1 -- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bb00d0920 msgr2=0x7f8bb00ac9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f8bb69a8640 1 --2- 172.21.15.63:0/2735284558 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8bb00d0920 0x7f8bb00ac9f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00c6b0 tx=0x7f8b9c00cb70 comp rx=0 tx=0).stop 2024-09-21T07:00:32.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f8bb4f45640 1 -- 172.21.15.63:0/2735284558 reap_dead start 2024-09-21T07:00:32.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 --> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4590144a40 con 0x7f4574080ee0 2024-09-21T07:00:32.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f8bb69a8640 1 -- 172.21.15.63:0/2735284558 shutdown_connections 2024-09-21T07:00:32.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f8bb69a8640 1 -- 172.21.15.63:0/2735284558 >> 172.21.15.63:0/2735284558 conn(0x7f8bb006cf90 msgr2=0x7f8bb015d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f8bb69a8640 1 -- 172.21.15.63:0/2735284558 shutdown_connections 2024-09-21T07:00:32.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7fd61f070640 1 -- 172.21.15.63:0/167466416 --> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd61813d930 con 0x7fd5fc080e60 2024-09-21T07:00:32.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f58fb7fe640 1 -- 172.21.15.63:0/904267074 >> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] conn(0x7f58f4080e50 msgr2=0x7f58f40832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f58fb7fe640 1 --2- 172.21.15.63:0/904267074 >> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] conn(0x7f58f4080e50 0x7f58f40832a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f8bb69a8640 1 -- 172.21.15.63:0/2735284558 wait complete. 2024-09-21T07:00:32.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.187+0000 7f4582ffd640 1 -- 172.21.15.63:0/2866739076 <== osd.4 v2:172.21.15.71:6802/3275296788 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4590144a40 con 0x7f4574080ee0 2024-09-21T07:00:32.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 --> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f726c052ef0 con 0x7f7258080e50 2024-09-21T07:00:32.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7fd6157fa640 1 -- 172.21.15.63:0/167466416 <== osd.6 v2:172.21.15.71:6810/3022228131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd61813d930 con 0x7fd5fc080e60 2024-09-21T07:00:32.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f58fb7fe640 1 -- 172.21.15.63:0/904267074 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f58f4078c60 msgr2=0x7f58f407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f58fb7fe640 1 --2- 172.21.15.63:0/904267074 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f58f4078c60 0x7f58f407b170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f590c00a7e0 tx=0x7f590c005ae0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f58fb7fe640 1 -- 172.21.15.63:0/904267074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f59100b4da0 msgr2=0x7f591014ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f58fb7fe640 1 --2- 172.21.15.63:0/904267074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f59100b4da0 0x7f591014ed40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5908030000 tx=0x7f5908008b20 comp rx=0 tx=0).stop 2024-09-21T07:00:32.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f59159ab640 1 -- 172.21.15.63:0/904267074 reap_dead start 2024-09-21T07:00:32.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f58fb7fe640 1 -- 172.21.15.63:0/904267074 shutdown_connections 2024-09-21T07:00:32.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f58fb7fe640 1 -- 172.21.15.63:0/904267074 >> 172.21.15.63:0/904267074 conn(0x7f59100b21c0 msgr2=0x7f5910075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f726a7fc640 1 -- 172.21.15.63:0/231825326 <== osd.7 v2:172.21.15.71:6818/829212065 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f726c052ef0 con 0x7f7258080e50 2024-09-21T07:00:32.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f58fb7fe640 1 -- 172.21.15.63:0/904267074 shutdown_connections 2024-09-21T07:00:32.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f58fb7fe640 1 -- 172.21.15.63:0/904267074 wait complete. 2024-09-21T07:00:32.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] conn(0x7f4574080ee0 msgr2=0x7f4574083330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f4597520640 1 --2- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] conn(0x7f4574080ee0 0x7f4574083330 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4574078c10 msgr2=0x7f457407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f4597520640 1 --2- 172.21.15.63:0/2866739076 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4574078c10 0x7f457407b120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4584000f60 tx=0x7f4584009040 comp rx=0 tx=0).stop 2024-09-21T07:00:32.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45900b32f0 msgr2=0x7f45900cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f4597520640 1 --2- 172.21.15.63:0/2866739076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f45900b32f0 0x7f45900cf390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4588009ef0 tx=0x7f458800be20 comp rx=0 tx=0).stop 2024-09-21T07:00:32.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7f4596d1f640 1 -- 172.21.15.63:0/2866739076 reap_dead start 2024-09-21T07:00:32.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] conn(0x7f7258080e50 msgr2=0x7f72580832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.188+0000 7f727ae6c640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] conn(0x7f7258080e50 0x7f72580832a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7fd61f070640 1 -- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] conn(0x7fd5fc080e60 msgr2=0x7fd5fc0832b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7fd61f070640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] conn(0x7fd5fc080e60 0x7fd5fc0832b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7258078c60 msgr2=0x7f725807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7f727ae6c640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7258078c60 0x7f725807b170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f726c034f50 tx=0x7f7264009040 comp rx=0 tx=0).stop 2024-09-21T07:00:32.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7fb518700640 1 -- 172.21.15.63:0/3747887251 --> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb51015e5d0 con 0x7fb4f4080f60 2024-09-21T07:00:32.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72600050c0 msgr2=0x7f726c04f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7f727ae6c640 1 --2- 172.21.15.63:0/231825326 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f72600050c0 0x7f726c04f510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f727000e740 tx=0x7f727000ec00 comp rx=0 tx=0).stop 2024-09-21T07:00:32.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7f727a66b640 1 -- 172.21.15.63:0/231825326 reap_dead start 2024-09-21T07:00:32.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7fd61f070640 1 -- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd5fc078b90 msgr2=0x7fd5fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7fd61f070640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd5fc078b90 0x7fd5fc07b0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd618155830 tx=0x7fd60c005f90 comp rx=0 tx=0).stop 2024-09-21T07:00:32.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 shutdown_connections 2024-09-21T07:00:32.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 >> 172.21.15.63:0/231825326 conn(0x7f726c01eac0 msgr2=0x7f726c008020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7fd61f070640 1 -- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6180ce370 msgr2=0x7fd61813cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7fd61f070640 1 --2- 172.21.15.63:0/167466416 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd6180ce370 0x7fd61813cfe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd61815d2b0 tx=0x7fd60400ef90 comp rx=0 tx=0).stop 2024-09-21T07:00:32.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7fd61d60d640 1 -- 172.21.15.63:0/167466416 reap_dead start 2024-09-21T07:00:32.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 shutdown_connections 2024-09-21T07:00:32.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 >> 172.21.15.63:0/2866739076 conn(0x7f45900d0000 msgr2=0x7f4590151650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 shutdown_connections 2024-09-21T07:00:32.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7f727ae6c640 1 -- 172.21.15.63:0/231825326 wait complete. 2024-09-21T07:00:32.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7fd61f070640 1 -- 172.21.15.63:0/167466416 shutdown_connections 2024-09-21T07:00:32.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.189+0000 7fd61f070640 1 -- 172.21.15.63:0/167466416 >> 172.21.15.63:0/167466416 conn(0x7fd6180b2f30 msgr2=0x7fd6180b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.190+0000 7fd61f070640 1 -- 172.21.15.63:0/167466416 shutdown_connections 2024-09-21T07:00:32.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.190+0000 7fb506ffd640 1 -- 172.21.15.63:0/3747887251 <== osd.3 v2:172.21.15.63:6816/1900864594 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb51015e5d0 con 0x7fb4f4080f60 2024-09-21T07:00:32.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.190+0000 7fd61f070640 1 -- 172.21.15.63:0/167466416 wait complete. 2024-09-21T07:00:32.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.191+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 shutdown_connections 2024-09-21T07:00:32.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.191+0000 7f4597520640 1 -- 172.21.15.63:0/2866739076 wait complete. 2024-09-21T07:00:32.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.191+0000 7fb518700640 1 -- 172.21.15.63:0/3747887251 >> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] conn(0x7fb4f4080f60 msgr2=0x7fb4f40833b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.191+0000 7fb518700640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] conn(0x7fb4f4080f60 0x7fb4f40833b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.192+0000 7fb518700640 1 -- 172.21.15.63:0/3747887251 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb4f4078c90 msgr2=0x7fb4f407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.192+0000 7fb518700640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb4f4078c90 0x7fb4f407b1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb5100ba990 tx=0x7fb50000a300 comp rx=0 tx=0).stop 2024-09-21T07:00:32.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.192+0000 7fb518700640 1 -- 172.21.15.63:0/3747887251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5100710b0 msgr2=0x7fb5100afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.192+0000 7fb518700640 1 --2- 172.21.15.63:0/3747887251 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb5100710b0 0x7fb5100afcc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00e680 tx=0x7fb50c00eb40 comp rx=0 tx=0).stop 2024-09-21T07:00:32.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.192+0000 7fb516c9d640 1 -- 172.21.15.63:0/3747887251 reap_dead start 2024-09-21T07:00:32.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.192+0000 7fb518700640 1 -- 172.21.15.63:0/3747887251 shutdown_connections 2024-09-21T07:00:32.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.192+0000 7fb518700640 1 -- 172.21.15.63:0/3747887251 >> 172.21.15.63:0/3747887251 conn(0x7fb51006d3e0 msgr2=0x7fb510074a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.193+0000 7fb518700640 1 -- 172.21.15.63:0/3747887251 shutdown_connections 2024-09-21T07:00:32.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.193+0000 7fb518700640 1 -- 172.21.15.63:0/3747887251 wait complete. 2024-09-21T07:00:32.219 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-21T07:00:32.220 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T07:00:32.220 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-21T07:00:32.221 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T07:00:32.221 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-21T07:00:32.222 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T07:00:32.222 INFO:teuthology.orchestra.run.smithi063.stdout:64424509448 2024-09-21T07:00:32.223 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T07:00:32.223 INFO:teuthology.orchestra.run.smithi063.stdout:64424509448 2024-09-21T07:00:32.223 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T07:00:32.224 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-21T07:00:32.224 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T07:00:32.225 INFO:teuthology.orchestra.run.smithi063.stdout:55834574856 2024-09-21T07:00:32.225 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T07:00:32.226 INFO:teuthology.orchestra.run.smithi063.stdout:64424509448 2024-09-21T07:00:32.226 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T07:00:32.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.480+0000 7f0d59b8a640 1 -- 172.21.15.63:0/3816251104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d540ccc80 msgr2=0x7f0d540cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.480+0000 7f0d59b8a640 1 --2- 172.21.15.63:0/3816251104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d540ccc80 0x7f0d540cd090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0d540721d0 tx=0x7f0d4402a4f0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.480+0000 7f0d59b8a640 1 -- 172.21.15.63:0/3816251104 shutdown_connections 2024-09-21T07:00:32.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.480+0000 7f0d59b8a640 1 --2- 172.21.15.63:0/3816251104 >> v2:172.21.15.63:3300/0 conn(0x7f0d540afbc0 0x7f0d540affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.480+0000 7f0d59b8a640 1 --2- 172.21.15.63:0/3816251104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d540ccc80 0x7f0d540cd090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.480+0000 7f0d59b8a640 1 -- 172.21.15.63:0/3816251104 >> 172.21.15.63:0/3816251104 conn(0x7f0d540b1d50 msgr2=0x7f0d540b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.481+0000 7f0d59b8a640 1 -- 172.21.15.63:0/3816251104 shutdown_connections 2024-09-21T07:00:32.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.481+0000 7f0d59b8a640 1 -- 172.21.15.63:0/3816251104 wait complete. 2024-09-21T07:00:32.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.484+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2278228828 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c280ce750 msgr2=0x7f6c280ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.484+0000 7f6c2d18b640 1 --2- 172.21.15.63:0/2278228828 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c280ce750 0x7f6c280ceb60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6c280cfb60 tx=0x7f6c1802a410 comp rx=0 tx=0).stop 2024-09-21T07:00:32.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.484+0000 7f0d59b8a640 1 Processor -- start 2024-09-21T07:00:32.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.484+0000 7f0d59b8a640 1 -- start start 2024-09-21T07:00:32.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.485+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2278228828 shutdown_connections 2024-09-21T07:00:32.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.485+0000 7f6c2d18b640 1 --2- 172.21.15.63:0/2278228828 >> v2:172.21.15.63:3300/0 conn(0x7f6c2815e5d0 0x7f6c2815e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.485+0000 7f6c2d18b640 1 --2- 172.21.15.63:0/2278228828 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c280ce750 0x7f6c280ceb60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.485+0000 7f6c2d18b640 1 --2- 172.21.15.63:0/2278228828 >> v2:172.21.15.71:3300/0 conn(0x7f6c280af410 0x7f6c280709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.485+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2278228828 >> 172.21.15.63:0/2278228828 conn(0x7f6c2806d3e0 msgr2=0x7f6c280b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.486+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2278228828 shutdown_connections 2024-09-21T07:00:32.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.486+0000 7f0d59b8a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d540afbc0 0x7f0d540ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.487+0000 7f817bd4a640 1 -- 172.21.15.63:0/749911842 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81740b1820 msgr2=0x7f8160003b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.487+0000 7f817bd4a640 1 --2- 172.21.15.63:0/749911842 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81740b1820 0x7f8160003b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f816800bb20 tx=0x7f8160005830 comp rx=0 tx=0).stop 2024-09-21T07:00:32.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.487+0000 7f817a2e7640 1 -- 172.21.15.63:0/749911842 reap_dead start 2024-09-21T07:00:32.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.487+0000 7f817bd4a640 1 -- 172.21.15.63:0/749911842 shutdown_connections 2024-09-21T07:00:32.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.487+0000 7f817bd4a640 1 -- 172.21.15.63:0/749911842 >> 172.21.15.63:0/749911842 conn(0x7f81740b1d50 msgr2=0x7f81740b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.487+0000 7f0d537fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d540afbc0 0x7f0d540ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.487+0000 7f0d537fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d540afbc0 0x7f0d540ad210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36912/0 (socket says 172.21.15.63:36912) 2024-09-21T07:00:32.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.487+0000 7f0d537fe640 1 -- 172.21.15.63:0/3658050951 learned_addr learned my addr 172.21.15.63:0/3658050951 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.488+0000 7f0d59b8a640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d540b0510 0x7f0d540ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.488+0000 7f1b99625640 1 -- 172.21.15.63:0/349147379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b9415bbb0 msgr2=0x7f1b940709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.488+0000 7f1b99625640 1 --2- 172.21.15.63:0/349147379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b9415bbb0 0x7f1b940709b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b940b3880 tx=0x7f1b8c02b830 comp rx=0 tx=0).stop 2024-09-21T07:00:32.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.488+0000 7f817bd4a640 1 -- 172.21.15.63:0/749911842 shutdown_connections 2024-09-21T07:00:32.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.488+0000 7f817bd4a640 1 -- 172.21.15.63:0/749911842 wait complete. 2024-09-21T07:00:32.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.488+0000 7f0d59b8a640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d540ccc80 0x7f0d54205b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.488+0000 7f0d52ffd640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d540b0510 0x7f0d540ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.488+0000 7f0d59b8a640 1 -- 172.21.15.63:0/3658050951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0d540cff30 con 0x7f0d540afbc0 2024-09-21T07:00:32.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.488+0000 7f0d59b8a640 1 -- 172.21.15.63:0/3658050951 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54073b20 con 0x7f0d540ccc80 2024-09-21T07:00:32.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.486+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2278228828 wait complete. 2024-09-21T07:00:32.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.488+0000 7f0d59b8a640 1 -- 172.21.15.63:0/3658050951 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0d540b2a80 con 0x7f0d540b0510 2024-09-21T07:00:32.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.488+0000 7f0d53fff640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d540ccc80 0x7f0d54205b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7f0d52ffd640 1 -- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d540ccc80 msgr2=0x7f0d54205b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7f0d52ffd640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d540ccc80 0x7f0d54205b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7f0d52ffd640 1 -- 172.21.15.63:0/3658050951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d540afbc0 msgr2=0x7f0d540ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7f1b99625640 1 -- 172.21.15.63:0/349147379 shutdown_connections 2024-09-21T07:00:32.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7f1b99625640 1 --2- 172.21.15.63:0/349147379 >> v2:172.21.15.71:3300/0 conn(0x7f1b9415e5d0 0x7f1b9415e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7f1b99625640 1 --2- 172.21.15.63:0/349147379 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b9415bbb0 0x7f1b940709b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7f1b99625640 1 -- 172.21.15.63:0/349147379 >> 172.21.15.63:0/349147379 conn(0x7f1b9406d3e0 msgr2=0x7f1b940b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7f0d52ffd640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d540afbc0 0x7f0d540ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7f0d52ffd640 1 -- 172.21.15.63:0/3658050951 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d54157f60 con 0x7f0d540b0510 2024-09-21T07:00:32.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7f0d537fe640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d540afbc0 0x7f0d540ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:00:32.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7f1b99625640 1 -- 172.21.15.63:0/349147379 shutdown_connections 2024-09-21T07:00:32.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7f1b99625640 1 -- 172.21.15.63:0/349147379 wait complete. 2024-09-21T07:00:32.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7f0d52ffd640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d540b0510 0x7f0d540ad750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800e9c0 tx=0x7f0d4800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7fcdcb239640 1 -- 172.21.15.63:0/3126787604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0004800 msgr2=0x7fcdb0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7fcdcb239640 1 --2- 172.21.15.63:0/3126787604 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0004800 0x7fcdb0004c10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000c340 tx=0x7fcdb0005830 comp rx=0 tx=0).stop 2024-09-21T07:00:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.489+0000 7fcdcaa38640 1 -- 172.21.15.63:0/3126787604 reap_dead start 2024-09-21T07:00:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.490+0000 7f0d3bfff640 1 -- 172.21.15.63:0/3658050951 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4800ccc0 con 0x7f0d540b0510 2024-09-21T07:00:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.490+0000 7f6c2d18b640 1 Processor -- start 2024-09-21T07:00:32.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.490+0000 7fcdcb239640 1 -- 172.21.15.63:0/3126787604 shutdown_connections 2024-09-21T07:00:32.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.490+0000 7fcdcb239640 1 -- 172.21.15.63:0/3126787604 >> 172.21.15.63:0/3126787604 conn(0x7fcdc40cece0 msgr2=0x7fcdc40cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.490+0000 7f0d59b8a640 1 -- 172.21.15.63:0/3658050951 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d540ae220 con 0x7f0d540b0510 2024-09-21T07:00:32.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.490+0000 7f0d59b8a640 1 -- 172.21.15.63:0/3658050951 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5415d570 con 0x7f0d540b0510 2024-09-21T07:00:32.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.490+0000 7f6c2d18b640 1 -- start start 2024-09-21T07:00:32.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.490+0000 7fcdcb239640 1 -- 172.21.15.63:0/3126787604 shutdown_connections 2024-09-21T07:00:32.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.490+0000 7fcdcb239640 1 -- 172.21.15.63:0/3126787604 wait complete. 2024-09-21T07:00:32.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.491+0000 7f817bd4a640 1 Processor -- start 2024-09-21T07:00:32.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.491+0000 7f817bd4a640 1 -- start start 2024-09-21T07:00:32.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.491+0000 7f0d3bfff640 1 -- 172.21.15.63:0/3658050951 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d4800ce60 con 0x7f0d540b0510 2024-09-21T07:00:32.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.491+0000 7f75471c3640 1 -- 172.21.15.63:0/662376510 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75401443f0 msgr2=0x7f75400cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.492+0000 7f75471c3640 1 --2- 172.21.15.63:0/662376510 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75401443f0 0x7f75400cc750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f75400cfbe0 tx=0x7f753402b8b0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.492+0000 7f75471c3640 1 -- 172.21.15.63:0/662376510 shutdown_connections 2024-09-21T07:00:32.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.492+0000 7f75471c3640 1 --2- 172.21.15.63:0/662376510 >> v2:172.21.15.63:3300/0 conn(0x7f7540073880 0x7f7540073c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.492+0000 7f75471c3640 1 --2- 172.21.15.63:0/662376510 >> v2:172.21.15.71:3300/0 conn(0x7f7540144800 0x7f75400ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.492+0000 7f75471c3640 1 --2- 172.21.15.63:0/662376510 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75401443f0 0x7f75400cc750 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.492+0000 7f75471c3640 1 -- 172.21.15.63:0/662376510 >> 172.21.15.63:0/662376510 conn(0x7f75400cd510 msgr2=0x7f75400cd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.492+0000 7f1b99625640 1 Processor -- start 2024-09-21T07:00:32.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.492+0000 7f1b99625640 1 -- start start 2024-09-21T07:00:32.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.492+0000 7f0d3bfff640 1 -- 172.21.15.63:0/3658050951 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48004220 con 0x7f0d540b0510 2024-09-21T07:00:32.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.493+0000 7f6c2d18b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c280af410 0x7f6c28159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.493+0000 7f0d3bfff640 1 -- 172.21.15.63:0/3658050951 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d480035f0 con 0x7f0d540b0510 2024-09-21T07:00:32.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.493+0000 7fcdcb239640 1 Processor -- start 2024-09-21T07:00:32.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.493+0000 7f0d39ffb640 1 -- 172.21.15.63:0/3658050951 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d540b1870 con 0x7f0d540b0510 2024-09-21T07:00:32.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.493+0000 7f817bd4a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81740b1820 0x7f81740c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.493+0000 7f6c2d18b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c280ce750 0x7f6c28157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.493+0000 7f6c2d18b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c2815e5d0 0x7f6c28098cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.493+0000 7fcdcb239640 1 -- start start 2024-09-21T07:00:32.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f6c2d18b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6c280ccd50 con 0x7f6c280ce750 2024-09-21T07:00:32.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f6c2659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c280ce750 0x7f6c28157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f6c2659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c280ce750 0x7f6c28157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36954/0 (socket says 172.21.15.63:36954) 2024-09-21T07:00:32.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f6c2659c640 1 -- 172.21.15.63:0/2322119174 learned_addr learned my addr 172.21.15.63:0/2322119174 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2322119174 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c280ccbd0 con 0x7f6c280af410 2024-09-21T07:00:32.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f21ea07c640 1 -- 172.21.15.63:0/1651149724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21d0004800 msgr2=0x7f21d0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f21ea07c640 1 --2- 172.21.15.63:0/1651149724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21d0004800 0x7f21d0004c50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21d4006fb0 tx=0x7f21d0005830 comp rx=0 tx=0).stop 2024-09-21T07:00:32.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f21ea07c640 1 -- 172.21.15.63:0/1651149724 shutdown_connections 2024-09-21T07:00:32.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f21ea07c640 1 --2- 172.21.15.63:0/1651149724 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21d0004800 0x7f21d0004c50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f75471c3640 1 -- 172.21.15.63:0/662376510 shutdown_connections 2024-09-21T07:00:32.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f75471c3640 1 -- 172.21.15.63:0/662376510 wait complete. 2024-09-21T07:00:32.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2322119174 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6c280cced0 con 0x7f6c2815e5d0 2024-09-21T07:00:32.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f21ea07c640 1 -- 172.21.15.63:0/1651149724 >> 172.21.15.63:0/1651149724 conn(0x7f21e408bfd0 msgr2=0x7f21e40d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f1b99625640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b940af410 0x7f1b9414ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f8179ae6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81740b1820 0x7f81740c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f1b99625640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b9415bbb0 0x7f1b9415dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f8179ae6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81740b1820 0x7f81740c99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36964/0 (socket says 172.21.15.63:36964) 2024-09-21T07:00:32.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f8179ae6640 1 -- 172.21.15.63:0/3705407638 learned_addr learned my addr 172.21.15.63:0/3705407638 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f817bd4a640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81740ba9c0 0x7f81741f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f1b99625640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b9415e5d0 0x7f1b94098550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f1b92ffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b940af410 0x7f1b9414ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f1b99625640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1b940ccbd0 con 0x7f1b9415e5d0 2024-09-21T07:00:32.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f1b99625640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b940712c0 con 0x7f1b9415bbb0 2024-09-21T07:00:32.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f1b99625640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1b940ccd50 con 0x7f1b940af410 2024-09-21T07:00:32.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f1b92ffd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b940af410 0x7f1b9414ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:58672/0 (socket says 172.21.15.63:58672) 2024-09-21T07:00:32.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f1b92ffd640 1 -- 172.21.15.63:0/2200783698 learned_addr learned my addr 172.21.15.63:0/2200783698 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f1b927fc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b9415bbb0 0x7f1b9415dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f1b937fe640 1 --2- 172.21.15.63:0/2200783698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b9415e5d0 0x7f1b94098550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f0d3bfff640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0d40078b90 0x7f0d4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f0d3bfff640 1 -- 172.21.15.63:0/3658050951 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0d4809b7f0 con 0x7f0d540b0510 2024-09-21T07:00:32.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f817bd4a640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81740badd0 0x7f81741f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f81792e5640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81740ba9c0 0x7f81741f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f817bd4a640 1 -- 172.21.15.63:0/3705407638 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f81740b1460 con 0x7f81740b1820 2024-09-21T07:00:32.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f817bd4a640 1 -- 172.21.15.63:0/3705407638 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f81740b12e0 con 0x7f81740badd0 2024-09-21T07:00:32.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f817bd4a640 1 -- 172.21.15.63:0/3705407638 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f81740aef30 con 0x7f81740ba9c0 2024-09-21T07:00:32.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f817a2e7640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81740badd0 0x7f81741f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f1b92ffd640 1 -- 172.21.15.63:0/2200783698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b9415bbb0 msgr2=0x7f1b9415dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f1b92ffd640 1 --2- 172.21.15.63:0/2200783698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b9415bbb0 0x7f1b9415dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f1b92ffd640 1 -- 172.21.15.63:0/2200783698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b9415e5d0 msgr2=0x7f1b94098550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f1b92ffd640 1 --2- 172.21.15.63:0/2200783698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b9415e5d0 0x7f1b94098550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f1b92ffd640 1 -- 172.21.15.63:0/2200783698 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b94150ce0 con 0x7f1b940af410 2024-09-21T07:00:32.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f1b92ffd640 1 --2- 172.21.15.63:0/2200783698 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b940af410 0x7f1b9414ed50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400c430 tx=0x7f1b8400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.494+0000 7f6c26d9d640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c280af410 0x7f6c28159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f6c2759e640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c2815e5d0 0x7f6c28098cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f6c2659c640 1 -- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c2815e5d0 msgr2=0x7f6c28098cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f6c2659c640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c2815e5d0 0x7f6c28098cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f6c2659c640 1 -- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c280af410 msgr2=0x7f6c28159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f6c2659c640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c280af410 0x7f6c28159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f6c2659c640 1 -- 172.21.15.63:0/2322119174 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c28098210 con 0x7f6c280ce750 2024-09-21T07:00:32.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f21ea07c640 1 -- 172.21.15.63:0/1651149724 shutdown_connections 2024-09-21T07:00:32.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f67a2490640 1 -- 172.21.15.63:0/4189855549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f679c156ac0 msgr2=0x7f679c0cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f21ea07c640 1 -- 172.21.15.63:0/1651149724 wait complete. 2024-09-21T07:00:32.510 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f67a2490640 1 --2- 172.21.15.63:0/4189855549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f679c156ac0 0x7f679c0cfe50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f678c005fd0 tx=0x7f678c02e4b0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f81792e5640 1 -- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81740badd0 msgr2=0x7f81741f9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f81792e5640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81740badd0 0x7f81741f9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f81792e5640 1 -- 172.21.15.63:0/3705407638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81740b1820 msgr2=0x7f81740c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.511 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.495+0000 7f6c2659c640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c280ce750 0x7f6c28157f30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6c180098f0 tx=0x7f6c18033f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7f81792e5640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81740b1820 0x7f81740c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7f81792e5640 1 -- 172.21.15.63:0/3705407638 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81740bb530 con 0x7f81740ba9c0 2024-09-21T07:00:32.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7f8179ae6640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81740b1820 0x7f81740c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:00:32.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7f6c0f7fe640 1 -- 172.21.15.63:0/2322119174 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18031b50 con 0x7f6c280ce750 2024-09-21T07:00:32.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7f6c0f7fe640 1 -- 172.21.15.63:0/2322119174 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c18031e00 con 0x7f6c280ce750 2024-09-21T07:00:32.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2322119174 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2809a590 con 0x7f6c280ce750 2024-09-21T07:00:32.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7f6c0f7fe640 1 -- 172.21.15.63:0/2322119174 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18005280 con 0x7f6c280ce750 2024-09-21T07:00:32.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7f81792e5640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81740ba9c0 0x7f81741f8c10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8170003e10 tx=0x7f8170001710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7fcdcb239640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0004800 0x7fcdc40b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7f67a2490640 1 -- 172.21.15.63:0/4189855549 shutdown_connections 2024-09-21T07:00:32.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7f67a2490640 1 --2- 172.21.15.63:0/4189855549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f679c156ac0 0x7f679c0cfe50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7f67a2490640 1 -- 172.21.15.63:0/4189855549 >> 172.21.15.63:0/4189855549 conn(0x7f679c0710a0 msgr2=0x7f679c0714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2322119174 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c280987b0 con 0x7f6c280ce750 2024-09-21T07:00:32.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7f0d537fe640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0d40078b90 0x7f0d4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7fcdcb239640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcdc41fc800 0x7fcdc41526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7fcdca237640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0004800 0x7fcdc40b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7fcdcb239640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdc41536d0 0x7fcdc4155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7fcdca237640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0004800 0x7fcdc40b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:56372/0 (socket says 172.21.15.63:56372) 2024-09-21T07:00:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7fcdcb239640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc40ccc40 con 0x7fcdc41536d0 2024-09-21T07:00:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7fcdcb239640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc40ccac0 con 0x7fcdb0004800 2024-09-21T07:00:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7fcdcb239640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc40ccdc0 con 0x7fcdc41fc800 2024-09-21T07:00:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.496+0000 7fcdca237640 1 -- 172.21.15.63:0/1335254091 learned_addr learned my addr 172.21.15.63:0/1335254091 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.497+0000 7f67a2490640 1 -- 172.21.15.63:0/4189855549 shutdown_connections 2024-09-21T07:00:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.497+0000 7f67a2490640 1 -- 172.21.15.63:0/4189855549 wait complete. 2024-09-21T07:00:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.497+0000 7fcdcaa38640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdc41536d0 0x7fcdc4155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.497+0000 7fcdc9a36640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcdc41fc800 0x7fcdc41526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.497+0000 7fcdca237640 1 -- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcdc41fc800 msgr2=0x7fcdc41526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.497+0000 7fcdca237640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcdc41fc800 0x7fcdc41526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.516 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.497+0000 7fcdca237640 1 -- 172.21.15.63:0/1335254091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdc41536d0 msgr2=0x7fcdc4155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.497+0000 7fcdca237640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdc41536d0 0x7fcdc4155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.497+0000 7fcdca237640 1 -- 172.21.15.63:0/1335254091 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc41fb760 con 0x7fcdb0004800 2024-09-21T07:00:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.497+0000 7f75471c3640 1 Processor -- start 2024-09-21T07:00:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.498+0000 7fcdca237640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0004800 0x7fcdc40b29a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400e650 tx=0x7fcdb400eb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.497+0000 7f0d537fe640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0d40078b90 0x7f0d4007b0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d44000c00 tx=0x7f0d44004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.498+0000 7f75471c3640 1 -- start start 2024-09-21T07:00:32.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.498+0000 7f21ea07c640 1 Processor -- start 2024-09-21T07:00:32.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.498+0000 7f21ea07c640 1 -- start start 2024-09-21T07:00:32.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.498+0000 7fcdbaffd640 1 -- 172.21.15.63:0/1335254091 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4005220 con 0x7fcdb0004800 2024-09-21T07:00:32.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.498+0000 7fcdcb239640 1 -- 172.21.15.63:0/1335254091 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc41fba40 con 0x7fcdb0004800 2024-09-21T07:00:32.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.498+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2322119174 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c280700f0 con 0x7f6c280ce750 2024-09-21T07:00:32.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.498+0000 7fcdbaffd640 1 -- 172.21.15.63:0/1335254091 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdb40053c0 con 0x7fcdb0004800 2024-09-21T07:00:32.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.498+0000 7fcdcb239640 1 -- 172.21.15.63:0/1335254091 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc41fc000 con 0x7fcdb0004800 2024-09-21T07:00:32.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.498+0000 7fcdbaffd640 1 -- 172.21.15.63:0/1335254091 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400c830 con 0x7fcdb0004800 2024-09-21T07:00:32.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.499+0000 7f6c0f7fe640 1 -- 172.21.15.63:0/2322119174 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c18005420 con 0x7f6c280ce750 2024-09-21T07:00:32.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f81667fc640 1 -- 172.21.15.63:0/3705407638 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170015070 con 0x7f81740ba9c0 2024-09-21T07:00:32.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f81667fc640 1 -- 172.21.15.63:0/3705407638 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8170011840 con 0x7f81740ba9c0 2024-09-21T07:00:32.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7fcdcb239640 1 -- 172.21.15.63:0/1335254091 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdac005290 con 0x7fcdb0004800 2024-09-21T07:00:32.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f817bd4a640 1 -- 172.21.15.63:0/3705407638 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81740bb810 con 0x7f81740ba9c0 2024-09-21T07:00:32.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f6c0f7fe640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6c14078b90 0x7f6c1407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f6c0f7fe640 1 -- 172.21.15.63:0/2322119174 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6c180bbe60 con 0x7f6c280ce750 2024-09-21T07:00:32.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f817bd4a640 1 -- 172.21.15.63:0/3705407638 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f81741f6880 con 0x7f81740ba9c0 2024-09-21T07:00:32.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f21ea07c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21d0004800 0x7f21e415c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f67a2490640 1 Processor -- start 2024-09-21T07:00:32.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f21ea07c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21e415cdb0 0x7f21e41e7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f21ea07c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21e41e76a0 0x7f21e41f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f21e907a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21d0004800 0x7f21e415c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f6c26d9d640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6c14078b90 0x7f6c1407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f1b7b7fe640 1 -- 172.21.15.63:0/2200783698 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b84017070 con 0x7f1b940af410 2024-09-21T07:00:32.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f1b7b7fe640 1 -- 172.21.15.63:0/2200783698 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b840053c0 con 0x7f1b940af410 2024-09-21T07:00:32.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f1b7b7fe640 1 -- 172.21.15.63:0/2200783698 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b840118b0 con 0x7f1b940af410 2024-09-21T07:00:32.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f21e907a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21d0004800 0x7f21e415c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:56378/0 (socket says 172.21.15.63:56378) 2024-09-21T07:00:32.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f21e8879640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21e415cdb0 0x7f21e41e7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.500+0000 7f21e8879640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21e415cdb0 0x7f21e41e7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:58688/0 (socket says 172.21.15.63:58688) 2024-09-21T07:00:32.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f21ea07c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f21e40b66d0 con 0x7f21e41e76a0 2024-09-21T07:00:32.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f75471c3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7540073880 0x7f75401e6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f67a2490640 1 -- start start 2024-09-21T07:00:32.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f81667fc640 1 -- 172.21.15.63:0/3705407638 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170015070 con 0x7f81740ba9c0 2024-09-21T07:00:32.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f75471c3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75401443f0 0x7f75401e68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f21ea07c640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21e40b6550 con 0x7f21d0004800 2024-09-21T07:00:32.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f75471c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7540144800 0x7f75401e47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f21ea07c640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f21e40b6850 con 0x7f21e415cdb0 2024-09-21T07:00:32.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f75471c3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7540069340 con 0x7f7540073880 2024-09-21T07:00:32.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f75471c3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f75400691c0 con 0x7f7540144800 2024-09-21T07:00:32.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f6c26d9d640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6c14078b90 0x7f6c1407b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000afd0 tx=0x7f6c2000e040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f21e987b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21e41e76a0 0x7f21e41f8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f21e987b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21e41e76a0 0x7f21e41f8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36988/0 (socket says 172.21.15.63:36988) 2024-09-21T07:00:32.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.502+0000 7f21e987b640 1 -- 172.21.15.63:0/4045003737 learned_addr learned my addr 172.21.15.63:0/4045003737 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.502+0000 7f817bd4a640 1 -- 172.21.15.63:0/3705407638 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81740ae410 con 0x7f81740ba9c0 2024-09-21T07:00:32.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.502+0000 7f0d3bfff640 1 -- 172.21.15.63:0/3658050951 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0d48063e10 con 0x7f0d540b0510 2024-09-21T07:00:32.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.502+0000 7f21e987b640 1 -- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21e415cdb0 msgr2=0x7f21e41e7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.502+0000 7f21e987b640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21e415cdb0 0x7f21e41e7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.502+0000 7f21e987b640 1 -- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21d0004800 msgr2=0x7f21e415c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.502+0000 7f21e987b640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21d0004800 0x7f21e415c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.502+0000 7f21e987b640 1 -- 172.21.15.63:0/4045003737 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e41e7ab0 con 0x7f21e41e76a0 2024-09-21T07:00:32.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.503+0000 7f21e987b640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21e41e76a0 0x7f21e41f8dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21e40d40b0 tx=0x7f21dc009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f75471c3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f754015e9d0 con 0x7f75401443f0 2024-09-21T07:00:32.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f7544f5f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7540073880 0x7f75401e6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.502+0000 7f753ffff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75401443f0 0x7f75401e68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.502+0000 7f7545760640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7540144800 0x7f75401e47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.502+0000 7f753ffff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75401443f0 0x7f75401e68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:58692/0 (socket says 172.21.15.63:58692) 2024-09-21T07:00:32.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.502+0000 7f753ffff640 1 -- 172.21.15.63:0/3215569711 learned_addr learned my addr 172.21.15.63:0/3215569711 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.503+0000 7f753ffff640 1 -- 172.21.15.63:0/3215569711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7540144800 msgr2=0x7f75401e47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.503+0000 7f753ffff640 1 --2- 172.21.15.63:0/3215569711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7540144800 0x7f75401e47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.503+0000 7f753ffff640 1 -- 172.21.15.63:0/3215569711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7540073880 msgr2=0x7f75401e6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.503+0000 7f81667fc640 1 -- 172.21.15.63:0/3705407638 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8170018070 con 0x7f81740ba9c0 2024-09-21T07:00:32.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.503+0000 7fcdbaffd640 1 -- 172.21.15.63:0/1335254091 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcdb400c9d0 con 0x7fcdb0004800 2024-09-21T07:00:32.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.503+0000 7f753ffff640 1 --2- 172.21.15.63:0/3215569711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7540073880 0x7f75401e6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.503+0000 7f753ffff640 1 -- 172.21.15.63:0/3215569711 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754013d300 con 0x7f75401443f0 2024-09-21T07:00:32.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.503+0000 7f7544f5f640 1 --2- 172.21.15.63:0/3215569711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7540073880 0x7f75401e6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:00:32.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.503+0000 7f21e907a640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21d0004800 0x7f21e415c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-21T07:00:32.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.503+0000 7f21e8879640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21e415cdb0 0x7f21e41e7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-21T07:00:32.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f1b99625640 1 -- 172.21.15.63:0/2200783698 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b94156990 con 0x7f1b940af410 2024-09-21T07:00:32.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.501+0000 7f1b99625640 1 -- 172.21.15.63:0/2200783698 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b94156f50 con 0x7f1b940af410 2024-09-21T07:00:32.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.503+0000 7f67a2490640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f679c072970 0x7f679c14c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.502+0000 7f1b99625640 1 -- 172.21.15.63:0/2200783698 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b9406ed50 con 0x7f1b940af410 2024-09-21T07:00:32.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.503+0000 7f753ffff640 1 --2- 172.21.15.63:0/3215569711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75401443f0 0x7f75401e68b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f752c00d6a0 tx=0x7f752c00db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f67a2490640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f679c156ac0 0x7f679c06ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f81667fc640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8158078d90 0x7f815807b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f67a148e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f679c072970 0x7f679c14c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f67a148e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f679c072970 0x7f679c14c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37004/0 (socket says 172.21.15.63:37004) 2024-09-21T07:00:32.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f1b7b7fe640 1 -- 172.21.15.63:0/2200783698 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1b8401a070 con 0x7f1b940af410 2024-09-21T07:00:32.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7fcdbaffd640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcda8078bc0 0x7fcda807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f81667fc640 1 -- 172.21.15.63:0/3705407638 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f817009b6b0 con 0x7f81740ba9c0 2024-09-21T07:00:32.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f8179ae6640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8158078d90 0x7f815807b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f67a148e640 1 -- 172.21.15.63:0/3739057408 learned_addr learned my addr 172.21.15.63:0/3739057408 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:32.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f67a2490640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f679c160010 0x7f679c06f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f67a0c8d640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f679c156ac0 0x7f679c06ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f67a2490640 1 -- 172.21.15.63:0/3739057408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f679c073610 con 0x7f679c072970 2024-09-21T07:00:32.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7fcdc9a36640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcda8078bc0 0x7fcda807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7fcdbaffd640 1 -- 172.21.15.63:0/1335254091 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcdb409b400 con 0x7fcdb0004800 2024-09-21T07:00:32.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f67a1c8f640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f679c160010 0x7f679c06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f67a2490640 1 -- 172.21.15.63:0/3739057408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f679c073490 con 0x7f679c156ac0 2024-09-21T07:00:32.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f67a2490640 1 -- 172.21.15.63:0/3739057408 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f679c073790 con 0x7f679c160010 2024-09-21T07:00:32.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.504+0000 7f8179ae6640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8158078d90 0x7f815807b2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8168000c00 tx=0x7f816803c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.505+0000 7f1b7b7fe640 1 --2- 172.21.15.63:0/2200783698 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1b80078be0 0x7f1b8007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.505+0000 7f1b7b7fe640 1 -- 172.21.15.63:0/2200783698 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1b84099fe0 con 0x7f1b940af410 2024-09-21T07:00:32.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.505+0000 7f1b927fc640 1 --2- 172.21.15.63:0/2200783698 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1b80078be0 0x7f1b8007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.505+0000 7fcdc9a36640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcda8078bc0 0x7fcda807b0d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000c310 tx=0x7fcdc00019f0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.505+0000 7f67a148e640 1 -- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f679c160010 msgr2=0x7f679c06f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.505+0000 7f67a148e640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f679c160010 0x7f679c06f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.505+0000 7f67a148e640 1 -- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f679c156ac0 msgr2=0x7f679c06ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.505+0000 7f67a148e640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f679c156ac0 0x7f679c06ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.505+0000 7f67a148e640 1 -- 172.21.15.63:0/3739057408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c152950 con 0x7f679c072970 2024-09-21T07:00:32.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.505+0000 7f67a0c8d640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f679c156ac0 0x7f679c06ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:00:32.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.505+0000 7f1b927fc640 1 --2- 172.21.15.63:0/2200783698 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1b80078be0 0x7f1b8007b0f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c036000 tx=0x7f1b8c004a40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.505+0000 7f67a148e640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f679c072970 0x7f679c14c990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f678c00dc60 tx=0x7f678c005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.507+0000 7f6791ffb640 1 -- 172.21.15.63:0/3739057408 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c044030 con 0x7f679c072970 2024-09-21T07:00:32.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.507+0000 7f67a2490640 1 -- 172.21.15.63:0/3739057408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679c1f1370 con 0x7f679c072970 2024-09-21T07:00:32.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.507+0000 7f21d9ffb640 1 -- 172.21.15.63:0/4045003737 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0108a0 con 0x7f21e41e76a0 2024-09-21T07:00:32.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.507+0000 7f21d9ffb640 1 -- 172.21.15.63:0/4045003737 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21dc018070 con 0x7f21e41e76a0 2024-09-21T07:00:32.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.507+0000 7f21d9ffb640 1 -- 172.21.15.63:0/4045003737 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc010d90 con 0x7f21e41e76a0 2024-09-21T07:00:32.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.507+0000 7f21ea07c640 1 -- 172.21.15.63:0/4045003737 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e40d16b0 con 0x7f21e41e76a0 2024-09-21T07:00:32.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.507+0000 7f6791ffb640 1 -- 172.21.15.63:0/3739057408 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f678c003ab0 con 0x7f679c072970 2024-09-21T07:00:32.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.507+0000 7f6c0f7fe640 1 -- 172.21.15.63:0/2322119174 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6c280700f0 con 0x7f6c280ce750 2024-09-21T07:00:32.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.507+0000 7f6791ffb640 1 -- 172.21.15.63:0/3739057408 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c003ce0 con 0x7f679c072970 2024-09-21T07:00:32.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.507+0000 7f67a2490640 1 -- 172.21.15.63:0/3739057408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679c1f58a0 con 0x7f679c072970 2024-09-21T07:00:32.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.507+0000 7f21ea07c640 1 -- 172.21.15.63:0/4045003737 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e40d1c70 con 0x7f21e41e76a0 2024-09-21T07:00:32.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.509+0000 7f81667fc640 1 -- 172.21.15.63:0/3705407638 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8170063380 con 0x7f81740ba9c0 2024-09-21T07:00:32.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.509+0000 7f67877fe640 1 -- 172.21.15.63:0/3739057408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6774005290 con 0x7f679c072970 2024-09-21T07:00:32.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.509+0000 7f21c77fe640 1 -- 172.21.15.63:0/4045003737 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e4161fe0 con 0x7f21e41e76a0 2024-09-21T07:00:32.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.508+0000 7f753d7fa640 1 -- 172.21.15.63:0/3215569711 <== mon.2 v2:172.21.15.71:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c016070 con 0x7f75401443f0 2024-09-21T07:00:32.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.508+0000 7f75471c3640 1 -- 172.21.15.63:0/3215569711 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75401e5b40 con 0x7f75401443f0 2024-09-21T07:00:32.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.508+0000 7f75471c3640 1 -- 172.21.15.63:0/3215569711 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75400b3e80 con 0x7f75401443f0 2024-09-21T07:00:32.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.509+0000 7fcdbaffd640 1 -- 172.21.15.63:0/1335254091 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcdb4063830 con 0x7fcdb0004800 2024-09-21T07:00:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.510+0000 7f75471c3640 1 -- 172.21.15.63:0/3215569711 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75400b0510 con 0x7f75401443f0 2024-09-21T07:00:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.511+0000 7f21d9ffb640 1 -- 172.21.15.63:0/4045003737 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21dc011470 con 0x7f21e41e76a0 2024-09-21T07:00:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.510+0000 7f6791ffb640 1 -- 172.21.15.63:0/3739057408 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f678c047070 con 0x7f679c072970 2024-09-21T07:00:32.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.511+0000 7f6791ffb640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6780078b90 0x7f678007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.511+0000 7f6791ffb640 1 -- 172.21.15.63:0/3739057408 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f678c0bff70 con 0x7f679c072970 2024-09-21T07:00:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.512+0000 7f21d9ffb640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f21c8078b90 0x7f21c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.512+0000 7f67a0c8d640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6780078b90 0x7f678007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.512+0000 7f21e907a640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f21c8078b90 0x7f21c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.512+0000 7f21d9ffb640 1 -- 172.21.15.63:0/4045003737 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f21dc09bf50 con 0x7f21e41e76a0 2024-09-21T07:00:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.513+0000 7f21e907a640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f21c8078b90 0x7f21c807b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f21e0001750 tx=0x7f21e0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.513+0000 7f67a0c8d640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6780078b90 0x7f678007b0a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f679c152550 tx=0x7f6798009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.513+0000 7f753d7fa640 1 -- 172.21.15.63:0/3215569711 <== mon.2 v2:172.21.15.71:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f752c009b10 con 0x7f75401443f0 2024-09-21T07:00:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.513+0000 7f753d7fa640 1 -- 172.21.15.63:0/3215569711 <== mon.2 v2:172.21.15.71:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c016070 con 0x7f75401443f0 2024-09-21T07:00:32.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.513+0000 7f1b7b7fe640 1 -- 172.21.15.63:0/2200783698 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1b84061e60 con 0x7f1b940af410 2024-09-21T07:00:32.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.515+0000 7f753d7fa640 1 -- 172.21.15.63:0/3215569711 <== mon.2 v2:172.21.15.71:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f752c010560 con 0x7f75401443f0 2024-09-21T07:00:32.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.516+0000 7f753d7fa640 1 --2- 172.21.15.63:0/3215569711 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7524078ff0 0x7f752407b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:32.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.517+0000 7f7544f5f640 1 --2- 172.21.15.63:0/3215569711 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7524078ff0 0x7f752407b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:32.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.517+0000 7f6791ffb640 1 -- 172.21.15.63:0/3739057408 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f678c04e070 con 0x7f679c072970 2024-09-21T07:00:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.517+0000 7f7544f5f640 1 --2- 172.21.15.63:0/3215569711 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7524078ff0 0x7f752407b500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7534035000 tx=0x7f75340046c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.517+0000 7f753d7fa640 1 -- 172.21.15.63:0/3215569711 <== mon.2 v2:172.21.15.71:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f752c009820 con 0x7f75401443f0 2024-09-21T07:00:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.519+0000 7f753d7fa640 1 -- 172.21.15.63:0/3215569711 <== mon.2 v2:172.21.15.71:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f752c028020 con 0x7f75401443f0 2024-09-21T07:00:32.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.526+0000 7f21d9ffb640 1 -- 172.21.15.63:0/4045003737 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f21e4161fe0 con 0x7f21e41e76a0 2024-09-21T07:00:32.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.941+0000 7f0d39ffb640 1 -- 172.21.15.63:0/3658050951 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0d540adfb0 con 0x7f0d540b0510 2024-09-21T07:00:32.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.942+0000 7f0d3bfff640 1 -- 172.21.15.63:0/3658050951 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0d48063710 con 0x7f0d540b0510 2024-09-21T07:00:32.944 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-21T07:00:32.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.945+0000 7f817bd4a640 1 -- 172.21.15.63:0/3705407638 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f81740bb2c0 con 0x7f81740ba9c0 2024-09-21T07:00:32.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.946+0000 7f0d39ffb640 1 -- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0d40078b90 msgr2=0x7f0d4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.946+0000 7f0d39ffb640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0d40078b90 0x7f0d4007b0a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0d44000c00 tx=0x7f0d44004730 comp rx=0 tx=0).stop 2024-09-21T07:00:32.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.946+0000 7f0d39ffb640 1 -- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d540b0510 msgr2=0x7f0d540ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.946+0000 7f0d39ffb640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d540b0510 0x7f0d540ad750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800e9c0 tx=0x7f0d4800ee80 comp rx=0 tx=0).stop 2024-09-21T07:00:32.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.946+0000 7f0d39ffb640 1 -- 172.21.15.63:0/3658050951 shutdown_connections 2024-09-21T07:00:32.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.946+0000 7f0d39ffb640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0d40078b90 0x7f0d4007b0a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.946+0000 7f0d39ffb640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d540ccc80 0x7f0d54205b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.946+0000 7f0d39ffb640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0d540b0510 0x7f0d540ad750 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.946+0000 7f81667fc640 1 -- 172.21.15.63:0/3705407638 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8170067db0 con 0x7f81740ba9c0 2024-09-21T07:00:32.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.946+0000 7f0d39ffb640 1 --2- 172.21.15.63:0/3658050951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0d540afbc0 0x7f0d540ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.949 INFO:teuthology.orchestra.run.smithi063.stdout:64424509448 2024-09-21T07:00:32.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.946+0000 7f0d39ffb640 1 -- 172.21.15.63:0/3658050951 >> 172.21.15.63:0/3658050951 conn(0x7f0d540b1d50 msgr2=0x7f0d540cbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.946+0000 7f0d39ffb640 1 -- 172.21.15.63:0/3658050951 shutdown_connections 2024-09-21T07:00:32.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.947+0000 7f0d39ffb640 1 -- 172.21.15.63:0/3658050951 wait complete. 2024-09-21T07:00:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.950+0000 7f817bd4a640 1 -- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8158078d90 msgr2=0x7f815807b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.950+0000 7f817bd4a640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8158078d90 0x7f815807b2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8168000c00 tx=0x7f816803c040 comp rx=0 tx=0).stop 2024-09-21T07:00:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.950+0000 7f817bd4a640 1 -- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81740ba9c0 msgr2=0x7f81741f8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.950+0000 7f817bd4a640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81740ba9c0 0x7f81741f8c10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8170003e10 tx=0x7f8170001710 comp rx=0 tx=0).stop 2024-09-21T07:00:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.950+0000 7f817bd4a640 1 -- 172.21.15.63:0/3705407638 shutdown_connections 2024-09-21T07:00:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.950+0000 7f817bd4a640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8158078d90 0x7f815807b2a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.950+0000 7f817bd4a640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f81740badd0 0x7f81741f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.950+0000 7f817bd4a640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f81740ba9c0 0x7f81741f8c10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.950+0000 7f817bd4a640 1 --2- 172.21.15.63:0/3705407638 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81740b1820 0x7f81740c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.951+0000 7f817bd4a640 1 -- 172.21.15.63:0/3705407638 >> 172.21.15.63:0/3705407638 conn(0x7f81740b1d50 msgr2=0x7f8174161f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.951+0000 7f817bd4a640 1 -- 172.21.15.63:0/3705407638 shutdown_connections 2024-09-21T07:00:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.951+0000 7f817bd4a640 1 -- 172.21.15.63:0/3705407638 wait complete. 2024-09-21T07:00:32.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.953+0000 7fcdcb239640 1 -- 172.21.15.63:0/1335254091 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fcdac005580 con 0x7fcdb0004800 2024-09-21T07:00:32.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.954+0000 7f1b99625640 1 -- 172.21.15.63:0/2200783698 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1b940c7090 con 0x7f1b940af410 2024-09-21T07:00:32.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.953+0000 7fcdbaffd640 1 -- 172.21.15.63:0/1335254091 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcdb4063130 con 0x7fcdb0004800 2024-09-21T07:00:32.956 INFO:teuthology.orchestra.run.smithi063.stdout:64424509447 2024-09-21T07:00:32.958 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-21T07:00:32.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.954+0000 7f1b7b7fe640 1 -- 172.21.15.63:0/2200783698 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b84066890 con 0x7f1b940af410 2024-09-21T07:00:32.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.957+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2322119174 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6c280cd3a0 con 0x7f6c280ce750 2024-09-21T07:00:32.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.958+0000 7fcdcb239640 1 -- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcda8078bc0 msgr2=0x7fcda807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.958+0000 7f6c0f7fe640 1 -- 172.21.15.63:0/2322119174 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6c1803f030 con 0x7f6c280ce750 2024-09-21T07:00:32.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.958+0000 7fcdcb239640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcda8078bc0 0x7fcda807b0d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000c310 tx=0x7fcdc00019f0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.958+0000 7fcdcb239640 1 -- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0004800 msgr2=0x7fcdc40b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.958+0000 7fcdcb239640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0004800 0x7fcdc40b29a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400e650 tx=0x7fcdb400eb10 comp rx=0 tx=0).stop 2024-09-21T07:00:32.961 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-09-21T07:00:32.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.958+0000 7fcdcb239640 1 -- 172.21.15.63:0/1335254091 shutdown_connections 2024-09-21T07:00:32.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.958+0000 7fcdcb239640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcda8078bc0 0x7fcda807b0d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.958+0000 7fcdcb239640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdc41536d0 0x7fcdc4155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.958+0000 7fcdcb239640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcdc41fc800 0x7fcdc41526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.958+0000 7f1b99625640 1 -- 172.21.15.63:0/2200783698 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1b80078be0 msgr2=0x7f1b8007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.958+0000 7f1b99625640 1 --2- 172.21.15.63:0/2200783698 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1b80078be0 0x7f1b8007b0f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c036000 tx=0x7f1b8c004a40 comp rx=0 tx=0).stop 2024-09-21T07:00:32.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.958+0000 7fcdcb239640 1 --2- 172.21.15.63:0/1335254091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0004800 0x7fcdc40b29a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.958+0000 7f1b99625640 1 -- 172.21.15.63:0/2200783698 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b940af410 msgr2=0x7f1b9414ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7f1b99625640 1 --2- 172.21.15.63:0/2200783698 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b940af410 0x7f1b9414ed50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400c430 tx=0x7f1b8400c8f0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7fcdcb239640 1 -- 172.21.15.63:0/1335254091 >> 172.21.15.63:0/1335254091 conn(0x7fcdc40cece0 msgr2=0x7fcdc40b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7f1b99625640 1 -- 172.21.15.63:0/2200783698 shutdown_connections 2024-09-21T07:00:32.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7f1b99625640 1 --2- 172.21.15.63:0/2200783698 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1b80078be0 0x7f1b8007b0f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7f1b99625640 1 --2- 172.21.15.63:0/2200783698 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1b9415e5d0 0x7f1b94098550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7f1b99625640 1 --2- 172.21.15.63:0/2200783698 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b9415bbb0 0x7f1b9415dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7f1b99625640 1 --2- 172.21.15.63:0/2200783698 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1b940af410 0x7f1b9414ed50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7f1b99625640 1 -- 172.21.15.63:0/2200783698 >> 172.21.15.63:0/2200783698 conn(0x7f1b9406d3e0 msgr2=0x7f1b940adb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7f67877fe640 1 -- 172.21.15.63:0/3739057408 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6774005850 con 0x7f679c072970 2024-09-21T07:00:32.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7f1b99625640 1 -- 172.21.15.63:0/2200783698 shutdown_connections 2024-09-21T07:00:32.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7f1b99625640 1 -- 172.21.15.63:0/2200783698 wait complete. 2024-09-21T07:00:32.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7fcdcb239640 1 -- 172.21.15.63:0/1335254091 shutdown_connections 2024-09-21T07:00:32.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7fcdcb239640 1 -- 172.21.15.63:0/1335254091 wait complete. 2024-09-21T07:00:32.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.959+0000 7f75471c3640 1 -- 172.21.15.63:0/3215569711 --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f754006e5f0 con 0x7f75401443f0 2024-09-21T07:00:32.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.960+0000 7f6791ffb640 1 -- 172.21.15.63:0/3739057408 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f678c04e070 con 0x7f679c072970 2024-09-21T07:00:32.966 INFO:teuthology.orchestra.run.smithi063.stdout:64424509448 2024-09-21T07:00:32.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.960+0000 7f753d7fa640 1 -- 172.21.15.63:0/3215569711 <== mon.2 v2:172.21.15.71:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f752c028020 con 0x7f75401443f0 2024-09-21T07:00:32.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.962+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6c14078b90 msgr2=0x7f6c1407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.962+0000 7f6c2d18b640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6c14078b90 0x7f6c1407b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000afd0 tx=0x7f6c2000e040 comp rx=0 tx=0).stop 2024-09-21T07:00:32.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.962+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2322119174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c280ce750 msgr2=0x7f6c28157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.962+0000 7f6c2d18b640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c280ce750 0x7f6c28157f30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6c180098f0 tx=0x7f6c18033f60 comp rx=0 tx=0).stop 2024-09-21T07:00:32.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.962+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2322119174 shutdown_connections 2024-09-21T07:00:32.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.962+0000 7f6c2d18b640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6c14078b90 0x7f6c1407b0a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.962+0000 7f6c2d18b640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c2815e5d0 0x7f6c28098cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.963+0000 7f6c2d18b640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c280ce750 0x7f6c28157f30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.963+0000 7f6c2d18b640 1 --2- 172.21.15.63:0/2322119174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c280af410 0x7f6c28159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.963+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2322119174 >> 172.21.15.63:0/2322119174 conn(0x7f6c2806d3e0 msgr2=0x7f6c2806f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.963+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2322119174 shutdown_connections 2024-09-21T07:00:32.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.963+0000 7f6c2d18b640 1 -- 172.21.15.63:0/2322119174 wait complete. 2024-09-21T07:00:32.968 INFO:teuthology.orchestra.run.smithi063.stdout:64424509448 2024-09-21T07:00:32.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f67877fe640 1 -- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6780078b90 msgr2=0x7f678007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f67877fe640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6780078b90 0x7f678007b0a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f679c152550 tx=0x7f6798009060 comp rx=0 tx=0).stop 2024-09-21T07:00:32.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f67877fe640 1 -- 172.21.15.63:0/3739057408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f679c072970 msgr2=0x7f679c14c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f75471c3640 1 -- 172.21.15.63:0/3215569711 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7524078ff0 msgr2=0x7f752407b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f75471c3640 1 --2- 172.21.15.63:0/3215569711 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7524078ff0 0x7f752407b500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7534035000 tx=0x7f75340046c0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f75471c3640 1 -- 172.21.15.63:0/3215569711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75401443f0 msgr2=0x7f75401e68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f75471c3640 1 --2- 172.21.15.63:0/3215569711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75401443f0 0x7f75401e68b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f752c00d6a0 tx=0x7f752c00db60 comp rx=0 tx=0).stop 2024-09-21T07:00:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f67877fe640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f679c072970 0x7f679c14c990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f678c00dc60 tx=0x7f678c005700 comp rx=0 tx=0).stop 2024-09-21T07:00:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f67877fe640 1 -- 172.21.15.63:0/3739057408 shutdown_connections 2024-09-21T07:00:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.965+0000 7f67877fe640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6780078b90 0x7f678007b0a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.965+0000 7f67877fe640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f679c160010 0x7f679c06f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.965+0000 7f67877fe640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f679c156ac0 0x7f679c06ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.965+0000 7f67877fe640 1 --2- 172.21.15.63:0/3739057408 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f679c072970 0x7f679c14c990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.965+0000 7f67877fe640 1 -- 172.21.15.63:0/3739057408 >> 172.21.15.63:0/3739057408 conn(0x7f679c0710a0 msgr2=0x7f679c0c8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.965+0000 7f67877fe640 1 -- 172.21.15.63:0/3739057408 shutdown_connections 2024-09-21T07:00:32.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.965+0000 7f67877fe640 1 -- 172.21.15.63:0/3739057408 wait complete. 2024-09-21T07:00:32.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f75471c3640 1 -- 172.21.15.63:0/3215569711 shutdown_connections 2024-09-21T07:00:32.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f75471c3640 1 --2- 172.21.15.63:0/3215569711 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7524078ff0 0x7f752407b500 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f75471c3640 1 --2- 172.21.15.63:0/3215569711 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7540144800 0x7f75401e47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f75471c3640 1 --2- 172.21.15.63:0/3215569711 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75401443f0 0x7f75401e68b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f75471c3640 1 --2- 172.21.15.63:0/3215569711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7540073880 0x7f75401e6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.964+0000 7f75471c3640 1 -- 172.21.15.63:0/3215569711 >> 172.21.15.63:0/3215569711 conn(0x7f75400cd510 msgr2=0x7f7540142c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.1 2024-09-21T07:00:32.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.966+0000 7f75471c3640 1 -- 172.21.15.63:0/3215569711 shutdown_connections 2024-09-21T07:00:32.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.966+0000 7f75471c3640 1 -- 172.21.15.63:0/3215569711 wait complete. 2024-09-21T07:00:32.972 DEBUG:teuthology.parallel:result is None 2024-09-21T07:00:32.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.968+0000 7f21c77fe640 1 -- 172.21.15.63:0/4045003737 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f21e41f6700 con 0x7f21e41e76a0 2024-09-21T07:00:32.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.969+0000 7f21d9ffb640 1 -- 172.21.15.63:0/4045003737 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f21e41e7ab0 con 0x7f21e41e76a0 2024-09-21T07:00:32.972 INFO:teuthology.orchestra.run.smithi063.stdout:55834574856 2024-09-21T07:00:32.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2024-09-21T07:00:32.974 DEBUG:teuthology.parallel:result is None 2024-09-21T07:00:32.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.973+0000 7f21c77fe640 1 -- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f21c8078b90 msgr2=0x7f21c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.973+0000 7f21c77fe640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f21c8078b90 0x7f21c807b0a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f21e0001750 tx=0x7f21e0009040 comp rx=0 tx=0).stop 2024-09-21T07:00:32.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.973+0000 7f21c77fe640 1 -- 172.21.15.63:0/4045003737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21e41e76a0 msgr2=0x7f21e41f8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:32.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.973+0000 7f21c77fe640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21e41e76a0 0x7f21e41f8dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21e40d40b0 tx=0x7f21dc009b00 comp rx=0 tx=0).stop 2024-09-21T07:00:32.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.973+0000 7f21c77fe640 1 -- 172.21.15.63:0/4045003737 shutdown_connections 2024-09-21T07:00:32.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.973+0000 7f21c77fe640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f21c8078b90 0x7f21c807b0a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.973+0000 7f21c77fe640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21e41e76a0 0x7f21e41f8dc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.973+0000 7f21c77fe640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f21e415cdb0 0x7f21e41e7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.973+0000 7f21c77fe640 1 --2- 172.21.15.63:0/4045003737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21d0004800 0x7f21e415c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:32.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.974+0000 7f21c77fe640 1 -- 172.21.15.63:0/4045003737 >> 172.21.15.63:0/4045003737 conn(0x7f21e408bfd0 msgr2=0x7f21e41614b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:32.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.974+0000 7f21c77fe640 1 -- 172.21.15.63:0/4045003737 shutdown_connections 2024-09-21T07:00:32.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:32.974+0000 7f21c77fe640 1 -- 172.21.15.63:0/4045003737 wait complete. 2024-09-21T07:00:32.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-09-21T07:00:32.983 DEBUG:teuthology.parallel:result is None 2024-09-21T07:00:32.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.0 2024-09-21T07:00:32.985 DEBUG:teuthology.parallel:result is None 2024-09-21T07:00:32.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.5 2024-09-21T07:00:32.987 DEBUG:teuthology.parallel:result is None 2024-09-21T07:00:32.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2024-09-21T07:00:32.989 DEBUG:teuthology.parallel:result is None 2024-09-21T07:00:32.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2024-09-21T07:00:32.990 DEBUG:teuthology.parallel:result is None 2024-09-21T07:00:32.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-09-21T07:00:32.993 DEBUG:teuthology.parallel:result is None 2024-09-21T07:00:32.993 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:00:32.993 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:00:33.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.148+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/2957194267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f080b3aa0 msgr2=0x7f2f080d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:33.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.148+0000 7f2f0ea4d640 1 --2- 172.21.15.63:0/2957194267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f080b3aa0 0x7f2f080d2fd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2f080b3eb0 tx=0x7f2ef802a4b0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.148+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/2957194267 shutdown_connections 2024-09-21T07:00:33.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.148+0000 7f2f0ea4d640 1 --2- 172.21.15.63:0/2957194267 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f0808c960 0x7f2f080d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.148+0000 7f2f0ea4d640 1 --2- 172.21.15.63:0/2957194267 >> v2:172.21.15.71:3300/0 conn(0x7f2f080b9aa0 0x7f2f080d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.148+0000 7f2f0ea4d640 1 --2- 172.21.15.63:0/2957194267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f080b3aa0 0x7f2f080d2fd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.148+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/2957194267 >> 172.21.15.63:0/2957194267 conn(0x7f2f080d45e0 msgr2=0x7f2f080d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:33.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.148+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/2957194267 shutdown_connections 2024-09-21T07:00:33.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.148+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/2957194267 wait complete. 2024-09-21T07:00:33.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.150+0000 7f2f0ea4d640 1 Processor -- start 2024-09-21T07:00:33.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.150+0000 7f2f0ea4d640 1 -- start start 2024-09-21T07:00:33.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.151+0000 7f2f0ea4d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f0808c960 0x7f2f080cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:33.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.151+0000 7f2f0ea4d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f080b3aa0 0x7f2f080ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:33.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.151+0000 7f2f0ea4d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f080b9aa0 0x7f2f081f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:33.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.151+0000 7f2f0ea4d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0806ed80 con 0x7f2f080b3aa0 2024-09-21T07:00:33.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.151+0000 7f2f0ea4d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0806ec00 con 0x7f2f080b9aa0 2024-09-21T07:00:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.151+0000 7f2f0ea4d640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2f0806ef00 con 0x7f2f0808c960 2024-09-21T07:00:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.151+0000 7f2f077fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f080b3aa0 0x7f2f080ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.151+0000 7f2f077fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f080b3aa0 0x7f2f080ce100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37020/0 (socket says 172.21.15.63:37020) 2024-09-21T07:00:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.151+0000 7f2f077fe640 1 -- 172.21.15.63:0/1380883849 learned_addr learned my addr 172.21.15.63:0/1380883849 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.151+0000 7f2f07fff640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f0808c960 0x7f2f080cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.151+0000 7f2f0cfea640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f080b9aa0 0x7f2f081f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.152+0000 7f2f077fe640 1 -- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f0808c960 msgr2=0x7f2f080cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.152+0000 7f2f077fe640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f0808c960 0x7f2f080cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.152+0000 7f2f077fe640 1 -- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f080b9aa0 msgr2=0x7f2f081f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.152+0000 7f2f077fe640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f080b9aa0 0x7f2f081f8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.152+0000 7f2f077fe640 1 -- 172.21.15.63:0/1380883849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f08159520 con 0x7f2f080b3aa0 2024-09-21T07:00:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.152+0000 7f2f077fe640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f080b3aa0 0x7f2f080ce100 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00d770 tx=0x7f2efc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:33.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.152+0000 7f2f04ff9640 1 -- 172.21.15.63:0/1380883849 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc017070 con 0x7f2f080b3aa0 2024-09-21T07:00:33.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.152+0000 7f2f04ff9640 1 -- 172.21.15.63:0/1380883849 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2efc009d20 con 0x7f2f080b3aa0 2024-09-21T07:00:33.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.152+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/1380883849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f08159800 con 0x7f2f080b3aa0 2024-09-21T07:00:33.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.152+0000 7f2f04ff9640 1 -- 172.21.15.63:0/1380883849 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0106c0 con 0x7f2f080b3aa0 2024-09-21T07:00:33.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.152+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/1380883849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f080cc570 con 0x7f2f080b3aa0 2024-09-21T07:00:33.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.153+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/1380883849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f080d2fd0 con 0x7f2f080b3aa0 2024-09-21T07:00:33.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.154+0000 7f2f04ff9640 1 -- 172.21.15.63:0/1380883849 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2efc01a070 con 0x7f2f080b3aa0 2024-09-21T07:00:33.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.154+0000 7f2f04ff9640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2ef4078b90 0x7f2ef407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:33.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.154+0000 7f2f04ff9640 1 -- 172.21.15.63:0/1380883849 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2efc09acc0 con 0x7f2f080b3aa0 2024-09-21T07:00:33.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.154+0000 7f2f07fff640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2ef4078b90 0x7f2ef407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:33.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.155+0000 7f2f07fff640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2ef4078b90 0x7f2ef407b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8034000 tx=0x7f2ef8004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:33.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.159+0000 7f2f04ff9640 1 -- 172.21.15.63:0/1380883849 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2efc062bd0 con 0x7f2f080b3aa0 2024-09-21T07:00:33.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.342+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/1380883849 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f080d1140 con 0x7f2ef4078b90 2024-09-21T07:00:33.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.346+0000 7f2f04ff9640 1 -- 172.21.15.63:0/1380883849 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251821 (secure 0 0 0) 0x7f2f080d1140 con 0x7f2ef4078b90 2024-09-21T07:00:33.352 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:33.353 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:00:33.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.349+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2ef4078b90 msgr2=0x7f2ef407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.349+0000 7f2f0ea4d640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2ef4078b90 0x7f2ef407b0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8034000 tx=0x7f2ef8004730 comp rx=0 tx=0).stop 2024-09-21T07:00:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.350+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/1380883849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f080b3aa0 msgr2=0x7f2f080ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.350+0000 7f2f0ea4d640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f080b3aa0 0x7f2f080ce100 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00d770 tx=0x7f2efc00dc30 comp rx=0 tx=0).stop 2024-09-21T07:00:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.350+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/1380883849 shutdown_connections 2024-09-21T07:00:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.350+0000 7f2f0ea4d640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2ef4078b90 0x7f2ef407b0a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.350+0000 7f2f0ea4d640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f080b9aa0 0x7f2f081f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.350+0000 7f2f0ea4d640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f080b3aa0 0x7f2f080ce100 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.350+0000 7f2f0ea4d640 1 --2- 172.21.15.63:0/1380883849 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f0808c960 0x7f2f080cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.350+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/1380883849 >> 172.21.15.63:0/1380883849 conn(0x7f2f080d45e0 msgr2=0x7f2f0806f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.350+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/1380883849 shutdown_connections 2024-09-21T07:00:33.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.350+0000 7f2f0ea4d640 1 -- 172.21.15.63:0/1380883849 wait complete. 2024-09-21T07:00:33.363 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-21T07:00:32.600172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219224,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755496,"statfs":{"total":773094113280,"available":772869627904,"internally_reserved":0,"allocated":3022848,"data_stored":1798068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.042455"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679263+0000","last_change":"2024-09-21T07:00:21.563189+0000","last_active":"2024-09-21T07:00:22.679263+0000","last_peered":"2024-09-21T07:00:22.679263+0000","last_clean":"2024-09-21T07:00:22.679263+0000","last_became_active":"2024-09-21T07:00:21.562870+0000","last_became_peered":"2024-09-21T07:00:21.562870+0000","last_unstale":"2024-09-21T07:00:22.679263+0000","last_undegraded":"2024-09-21T07:00:22.679263+0000","last_fullsized":"2024-09-21T07:00:22.679263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:10.283749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679665+0000","last_change":"2024-09-21T07:00:21.562578+0000","last_active":"2024-09-21T07:00:22.679665+0000","last_peered":"2024-09-21T07:00:22.679665+0000","last_clean":"2024-09-21T07:00:22.679665+0000","last_became_active":"2024-09-21T07:00:21.560210+0000","last_became_peered":"2024-09-21T07:00:21.560210+0000","last_unstale":"2024-09-21T07:00:22.679665+0000","last_undegraded":"2024-09-21T07:00:22.679665+0000","last_fullsized":"2024-09-21T07:00:22.679665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:21.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679819+0000","last_change":"2024-09-21T07:00:21.558740+0000","last_active":"2024-09-21T07:00:22.679819+0000","last_peered":"2024-09-21T07:00:22.679819+0000","last_clean":"2024-09-21T07:00:22.679819+0000","last_became_active":"2024-09-21T07:00:21.558262+0000","last_became_peered":"2024-09-21T07:00:21.558262+0000","last_unstale":"2024-09-21T07:00:22.679819+0000","last_undegraded":"2024-09-21T07:00:22.679819+0000","last_fullsized":"2024-09-21T07:00:22.679819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:13.795076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559508+0000","last_change":"2024-09-21T07:00:21.572137+0000","last_active":"2024-09-21T07:00:22.559508+0000","last_peered":"2024-09-21T07:00:22.559508+0000","last_clean":"2024-09-21T07:00:22.559508+0000","last_became_active":"2024-09-21T07:00:21.571794+0000","last_became_peered":"2024-09-21T07:00:21.571794+0000","last_unstale":"2024-09-21T07:00:22.559508+0000","last_undegraded":"2024-09-21T07:00:22.559508+0000","last_fullsized":"2024-09-21T07:00:22.559508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:30.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679078+0000","last_change":"2024-09-21T07:00:21.564124+0000","last_active":"2024-09-21T07:00:22.679078+0000","last_peered":"2024-09-21T07:00:22.679078+0000","last_clean":"2024-09-21T07:00:22.679078+0000","last_became_active":"2024-09-21T07:00:21.563782+0000","last_became_peered":"2024-09-21T07:00:21.563782+0000","last_unstale":"2024-09-21T07:00:22.679078+0000","last_undegraded":"2024-09-21T07:00:22.679078+0000","last_fullsized":"2024-09-21T07:00:22.679078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:56.959773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559317+0000","last_change":"2024-09-21T07:00:21.570373+0000","last_active":"2024-09-21T07:00:22.559317+0000","last_peered":"2024-09-21T07:00:22.559317+0000","last_clean":"2024-09-21T07:00:22.559317+0000","last_became_active":"2024-09-21T07:00:21.570032+0000","last_became_peered":"2024-09-21T07:00:21.570032+0000","last_unstale":"2024-09-21T07:00:22.559317+0000","last_undegraded":"2024-09-21T07:00:22.559317+0000","last_fullsized":"2024-09-21T07:00:22.559317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:46.611937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678752+0000","last_change":"2024-09-21T07:00:21.564072+0000","last_active":"2024-09-21T07:00:22.678752+0000","last_peered":"2024-09-21T07:00:22.678752+0000","last_clean":"2024-09-21T07:00:22.678752+0000","last_became_active":"2024-09-21T07:00:21.563740+0000","last_became_peered":"2024-09-21T07:00:21.563740+0000","last_unstale":"2024-09-21T07:00:22.678752+0000","last_undegraded":"2024-09-21T07:00:22.678752+0000","last_fullsized":"2024-09-21T07:00:22.678752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:43.306215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679196+0000","last_change":"2024-09-21T07:00:21.571903+0000","last_active":"2024-09-21T07:00:22.679196+0000","last_peered":"2024-09-21T07:00:22.679196+0000","last_clean":"2024-09-21T07:00:22.679196+0000","last_became_active":"2024-09-21T07:00:21.571504+0000","last_became_peered":"2024-09-21T07:00:21.571504+0000","last_unstale":"2024-09-21T07:00:22.679196+0000","last_undegraded":"2024-09-21T07:00:22.679196+0000","last_fullsized":"2024-09-21T07:00:22.679196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:12.175330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678344+0000","last_change":"2024-09-21T07:00:21.560654+0000","last_active":"2024-09-21T07:00:22.678344+0000","last_peered":"2024-09-21T07:00:22.678344+0000","last_clean":"2024-09-21T07:00:22.678344+0000","last_became_active":"2024-09-21T07:00:21.560359+0000","last_became_peered":"2024-09-21T07:00:21.560359+0000","last_unstale":"2024-09-21T07:00:22.678344+0000","last_undegraded":"2024-09-21T07:00:22.678344+0000","last_fullsized":"2024-09-21T07:00:22.678344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:18.578209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678878+0000","last_change":"2024-09-21T07:00:21.567336+0000","last_active":"2024-09-21T07:00:22.678878+0000","last_peered":"2024-09-21T07:00:22.678878+0000","last_clean":"2024-09-21T07:00:22.678878+0000","last_became_active":"2024-09-21T07:00:21.566797+0000","last_became_peered":"2024-09-21T07:00:21.566797+0000","last_unstale":"2024-09-21T07:00:22.678878+0000","last_undegraded":"2024-09-21T07:00:22.678878+0000","last_fullsized":"2024-09-21T07:00:22.678878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:40.090374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678934+0000","last_change":"2024-09-21T07:00:21.563225+0000","last_active":"2024-09-21T07:00:22.678934+0000","last_peered":"2024-09-21T07:00:22.678934+0000","last_clean":"2024-09-21T07:00:22.678934+0000","last_became_active":"2024-09-21T07:00:21.560365+0000","last_became_peered":"2024-09-21T07:00:21.560365+0000","last_unstale":"2024-09-21T07:00:22.678934+0000","last_undegraded":"2024-09-21T07:00:22.678934+0000","last_fullsized":"2024-09-21T07:00:22.678934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:39.852924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678783+0000","last_change":"2024-09-21T07:00:21.562837+0000","last_active":"2024-09-21T07:00:22.678783+0000","last_peered":"2024-09-21T07:00:22.678783+0000","last_clean":"2024-09-21T07:00:22.678783+0000","last_became_active":"2024-09-21T07:00:21.560315+0000","last_became_peered":"2024-09-21T07:00:21.560315+0000","last_unstale":"2024-09-21T07:00:22.678783+0000","last_undegraded":"2024-09-21T07:00:22.678783+0000","last_fullsized":"2024-09-21T07:00:22.678783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:34:47.707070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678905+0000","last_change":"2024-09-21T07:00:21.562487+0000","last_active":"2024-09-21T07:00:22.678905+0000","last_peered":"2024-09-21T07:00:22.678905+0000","last_clean":"2024-09-21T07:00:22.678905+0000","last_became_active":"2024-09-21T07:00:21.562191+0000","last_became_peered":"2024-09-21T07:00:21.562191+0000","last_unstale":"2024-09-21T07:00:22.678905+0000","last_undegraded":"2024-09-21T07:00:22.678905+0000","last_fullsized":"2024-09-21T07:00:22.678905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:56.671345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678874+0000","last_change":"2024-09-21T07:00:21.553283+0000","last_active":"2024-09-21T07:00:22.678874+0000","last_peered":"2024-09-21T07:00:22.678874+0000","last_clean":"2024-09-21T07:00:22.678874+0000","last_became_active":"2024-09-21T07:00:21.552964+0000","last_became_peered":"2024-09-21T07:00:21.552964+0000","last_unstale":"2024-09-21T07:00:22.678874+0000","last_undegraded":"2024-09-21T07:00:22.678874+0000","last_fullsized":"2024-09-21T07:00:22.678874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:45.103534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678984+0000","last_change":"2024-09-21T07:00:21.571890+0000","last_active":"2024-09-21T07:00:22.678984+0000","last_peered":"2024-09-21T07:00:22.678984+0000","last_clean":"2024-09-21T07:00:22.678984+0000","last_became_active":"2024-09-21T07:00:21.571519+0000","last_became_peered":"2024-09-21T07:00:21.571519+0000","last_unstale":"2024-09-21T07:00:22.678984+0000","last_undegraded":"2024-09-21T07:00:22.678984+0000","last_fullsized":"2024-09-21T07:00:22.678984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:02.733307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555427+0000","last_change":"2024-09-21T07:00:21.552279+0000","last_active":"2024-09-21T07:00:22.555427+0000","last_peered":"2024-09-21T07:00:22.555427+0000","last_clean":"2024-09-21T07:00:22.555427+0000","last_became_active":"2024-09-21T07:00:21.551937+0000","last_became_peered":"2024-09-21T07:00:21.551937+0000","last_unstale":"2024-09-21T07:00:22.555427+0000","last_undegraded":"2024-09-21T07:00:22.555427+0000","last_fullsized":"2024-09-21T07:00:22.555427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:03.253724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556346+0000","last_change":"2024-09-21T07:00:21.565756+0000","last_active":"2024-09-21T07:00:22.556346+0000","last_peered":"2024-09-21T07:00:22.556346+0000","last_clean":"2024-09-21T07:00:22.556346+0000","last_became_active":"2024-09-21T07:00:21.565449+0000","last_became_peered":"2024-09-21T07:00:21.565449+0000","last_unstale":"2024-09-21T07:00:22.556346+0000","last_undegraded":"2024-09-21T07:00:22.556346+0000","last_fullsized":"2024-09-21T07:00:22.556346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:15.636322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679671+0000","last_change":"2024-09-21T07:00:21.565470+0000","last_active":"2024-09-21T07:00:22.679671+0000","last_peered":"2024-09-21T07:00:22.679671+0000","last_clean":"2024-09-21T07:00:22.679671+0000","last_became_active":"2024-09-21T07:00:21.565119+0000","last_became_peered":"2024-09-21T07:00:21.565119+0000","last_unstale":"2024-09-21T07:00:22.679671+0000","last_undegraded":"2024-09-21T07:00:22.679671+0000","last_fullsized":"2024-09-21T07:00:22.679671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:30.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556259+0000","last_change":"2024-09-21T07:00:21.551138+0000","last_active":"2024-09-21T07:00:22.556259+0000","last_peered":"2024-09-21T07:00:22.556259+0000","last_clean":"2024-09-21T07:00:22.556259+0000","last_became_active":"2024-09-21T07:00:21.550659+0000","last_became_peered":"2024-09-21T07:00:21.550659+0000","last_unstale":"2024-09-21T07:00:22.556259+0000","last_undegraded":"2024-09-21T07:00:22.556259+0000","last_fullsized":"2024-09-21T07:00:22.556259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:40.906741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679056+0000","last_change":"2024-09-21T07:00:21.563105+0000","last_active":"2024-09-21T07:00:22.679056+0000","last_peered":"2024-09-21T07:00:22.679056+0000","last_clean":"2024-09-21T07:00:22.679056+0000","last_became_active":"2024-09-21T07:00:21.559949+0000","last_became_peered":"2024-09-21T07:00:21.559949+0000","last_unstale":"2024-09-21T07:00:22.679056+0000","last_undegraded":"2024-09-21T07:00:22.679056+0000","last_fullsized":"2024-09-21T07:00:22.679056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:02.486805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560203+0000","last_change":"2024-09-21T07:00:21.558126+0000","last_active":"2024-09-21T07:00:22.560203+0000","last_peered":"2024-09-21T07:00:22.560203+0000","last_clean":"2024-09-21T07:00:22.560203+0000","last_became_active":"2024-09-21T07:00:21.557784+0000","last_became_peered":"2024-09-21T07:00:21.557784+0000","last_unstale":"2024-09-21T07:00:22.560203+0000","last_undegraded":"2024-09-21T07:00:22.560203+0000","last_fullsized":"2024-09-21T07:00:22.560203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:08.303864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678141+0000","last_change":"2024-09-21T07:00:21.564458+0000","last_active":"2024-09-21T07:00:22.678141+0000","last_peered":"2024-09-21T07:00:22.678141+0000","last_clean":"2024-09-21T07:00:22.678141+0000","last_became_active":"2024-09-21T07:00:21.564109+0000","last_became_peered":"2024-09-21T07:00:21.564109+0000","last_unstale":"2024-09-21T07:00:22.678141+0000","last_undegraded":"2024-09-21T07:00:22.678141+0000","last_fullsized":"2024-09-21T07:00:22.678141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:59.060831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679386+0000","last_change":"2024-09-21T07:00:21.565436+0000","last_active":"2024-09-21T07:00:22.679386+0000","last_peered":"2024-09-21T07:00:22.679386+0000","last_clean":"2024-09-21T07:00:22.679386+0000","last_became_active":"2024-09-21T07:00:21.565144+0000","last_became_peered":"2024-09-21T07:00:21.565144+0000","last_unstale":"2024-09-21T07:00:22.679386+0000","last_undegraded":"2024-09-21T07:00:22.679386+0000","last_fullsized":"2024-09-21T07:00:22.679386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:22.045462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555426+0000","last_change":"2024-09-21T07:00:21.561626+0000","last_active":"2024-09-21T07:00:22.555426+0000","last_peered":"2024-09-21T07:00:22.555426+0000","last_clean":"2024-09-21T07:00:22.555426+0000","last_became_active":"2024-09-21T07:00:21.561134+0000","last_became_peered":"2024-09-21T07:00:21.561134+0000","last_unstale":"2024-09-21T07:00:22.555426+0000","last_undegraded":"2024-09-21T07:00:22.555426+0000","last_fullsized":"2024-09-21T07:00:22.555426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:56.959773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679918+0000","last_change":"2024-09-21T07:00:21.557981+0000","last_active":"2024-09-21T07:00:22.679918+0000","last_peered":"2024-09-21T07:00:22.679918+0000","last_clean":"2024-09-21T07:00:22.679918+0000","last_became_active":"2024-09-21T07:00:21.557675+0000","last_became_peered":"2024-09-21T07:00:21.557675+0000","last_unstale":"2024-09-21T07:00:22.679918+0000","last_undegraded":"2024-09-21T07:00:22.679918+0000","last_fullsized":"2024-09-21T07:00:22.679918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:49.917053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559596+0000","last_change":"2024-09-21T07:00:21.566434+0000","last_active":"2024-09-21T07:00:22.559596+0000","last_peered":"2024-09-21T07:00:22.559596+0000","last_clean":"2024-09-21T07:00:22.559596+0000","last_became_active":"2024-09-21T07:00:21.566140+0000","last_became_peered":"2024-09-21T07:00:21.566140+0000","last_unstale":"2024-09-21T07:00:22.559596+0000","last_undegraded":"2024-09-21T07:00:22.559596+0000","last_fullsized":"2024-09-21T07:00:22.559596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:56.962006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680033+0000","last_change":"2024-09-21T07:00:21.554587+0000","last_active":"2024-09-21T07:00:22.680033+0000","last_peered":"2024-09-21T07:00:22.680033+0000","last_clean":"2024-09-21T07:00:22.680033+0000","last_became_active":"2024-09-21T07:00:21.553603+0000","last_became_peered":"2024-09-21T07:00:21.553603+0000","last_unstale":"2024-09-21T07:00:22.680033+0000","last_undegraded":"2024-09-21T07:00:22.680033+0000","last_fullsized":"2024-09-21T07:00:22.680033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:09.948521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679387+0000","last_change":"2024-09-21T07:00:21.563521+0000","last_active":"2024-09-21T07:00:22.679387+0000","last_peered":"2024-09-21T07:00:22.679387+0000","last_clean":"2024-09-21T07:00:22.679387+0000","last_became_active":"2024-09-21T07:00:21.563231+0000","last_became_peered":"2024-09-21T07:00:21.563231+0000","last_unstale":"2024-09-21T07:00:22.679387+0000","last_undegraded":"2024-09-21T07:00:22.679387+0000","last_fullsized":"2024-09-21T07:00:22.679387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:09.410925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680038+0000","last_change":"2024-09-21T07:00:21.562180+0000","last_active":"2024-09-21T07:00:22.680038+0000","last_peered":"2024-09-21T07:00:22.680038+0000","last_clean":"2024-09-21T07:00:22.680038+0000","last_became_active":"2024-09-21T07:00:21.561470+0000","last_became_peered":"2024-09-21T07:00:21.561470+0000","last_unstale":"2024-09-21T07:00:22.680038+0000","last_undegraded":"2024-09-21T07:00:22.680038+0000","last_fullsized":"2024-09-21T07:00:22.680038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:37.907222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555639+0000","last_change":"2024-09-21T07:00:21.556962+0000","last_active":"2024-09-21T07:00:22.555639+0000","last_peered":"2024-09-21T07:00:22.555639+0000","last_clean":"2024-09-21T07:00:22.555639+0000","last_became_active":"2024-09-21T07:00:21.556476+0000","last_became_peered":"2024-09-21T07:00:21.556476+0000","last_unstale":"2024-09-21T07:00:22.555639+0000","last_undegraded":"2024-09-21T07:00:22.555639+0000","last_fullsized":"2024-09-21T07:00:22.555639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:45.749731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678807+0000","last_change":"2024-09-21T07:00:21.556889+0000","last_active":"2024-09-21T07:00:22.678807+0000","last_peered":"2024-09-21T07:00:22.678807+0000","last_clean":"2024-09-21T07:00:22.678807+0000","last_became_active":"2024-09-21T07:00:21.556591+0000","last_became_peered":"2024-09-21T07:00:21.556591+0000","last_unstale":"2024-09-21T07:00:22.678807+0000","last_undegraded":"2024-09-21T07:00:22.678807+0000","last_fullsized":"2024-09-21T07:00:22.678807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:46.611937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559221+0000","last_change":"2024-09-21T07:00:21.553852+0000","last_active":"2024-09-21T07:00:22.559221+0000","last_peered":"2024-09-21T07:00:22.559221+0000","last_clean":"2024-09-21T07:00:22.559221+0000","last_became_active":"2024-09-21T07:00:21.553416+0000","last_became_peered":"2024-09-21T07:00:21.553416+0000","last_unstale":"2024-09-21T07:00:22.559221+0000","last_undegraded":"2024-09-21T07:00:22.559221+0000","last_fullsized":"2024-09-21T07:00:22.559221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:59.060831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678185+0000","last_change":"2024-09-21T07:00:21.555826+0000","last_active":"2024-09-21T07:00:22.678185+0000","last_peered":"2024-09-21T07:00:22.678185+0000","last_clean":"2024-09-21T07:00:22.678185+0000","last_became_active":"2024-09-21T07:00:21.555430+0000","last_became_peered":"2024-09-21T07:00:21.555430+0000","last_unstale":"2024-09-21T07:00:22.678185+0000","last_undegraded":"2024-09-21T07:00:22.678185+0000","last_fullsized":"2024-09-21T07:00:22.678185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:46.611937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679918+0000","last_change":"2024-09-21T07:00:20.549521+0000","last_active":"2024-09-21T07:00:22.679918+0000","last_peered":"2024-09-21T07:00:22.679918+0000","last_clean":"2024-09-21T07:00:22.679918+0000","last_became_active":"2024-09-21T07:00:20.549184+0000","last_became_peered":"2024-09-21T07:00:20.549184+0000","last_unstale":"2024-09-21T07:00:22.679918+0000","last_undegraded":"2024-09-21T07:00:22.679918+0000","last_fullsized":"2024-09-21T07:00:22.679918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:18.707436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559636+0000","last_change":"2024-09-21T07:00:21.565217+0000","last_active":"2024-09-21T07:00:22.559636+0000","last_peered":"2024-09-21T07:00:22.559636+0000","last_clean":"2024-09-21T07:00:22.559636+0000","last_became_active":"2024-09-21T07:00:21.564900+0000","last_became_peered":"2024-09-21T07:00:21.564900+0000","last_unstale":"2024-09-21T07:00:22.559636+0000","last_undegraded":"2024-09-21T07:00:22.559636+0000","last_fullsized":"2024-09-21T07:00:22.559636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:54.612942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555720+0000","last_change":"2024-09-21T07:00:20.550510+0000","last_active":"2024-09-21T07:00:22.555720+0000","last_peered":"2024-09-21T07:00:22.555720+0000","last_clean":"2024-09-21T07:00:22.555720+0000","last_became_active":"2024-09-21T07:00:20.550109+0000","last_became_peered":"2024-09-21T07:00:20.550109+0000","last_unstale":"2024-09-21T07:00:22.555720+0000","last_undegraded":"2024-09-21T07:00:22.555720+0000","last_fullsized":"2024-09-21T07:00:22.555720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:17.572663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679063+0000","last_change":"2024-09-21T07:00:20.559604+0000","last_active":"2024-09-21T07:00:22.679063+0000","last_peered":"2024-09-21T07:00:22.679063+0000","last_clean":"2024-09-21T07:00:22.679063+0000","last_became_active":"2024-09-21T07:00:20.559313+0000","last_became_peered":"2024-09-21T07:00:20.559313+0000","last_unstale":"2024-09-21T07:00:22.679063+0000","last_undegraded":"2024-09-21T07:00:22.679063+0000","last_fullsized":"2024-09-21T07:00:22.679063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:35.935572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679467+0000","last_change":"2024-09-21T07:00:21.555824+0000","last_active":"2024-09-21T07:00:22.679467+0000","last_peered":"2024-09-21T07:00:22.679467+0000","last_clean":"2024-09-21T07:00:22.679467+0000","last_became_active":"2024-09-21T07:00:21.554777+0000","last_became_peered":"2024-09-21T07:00:21.554777+0000","last_unstale":"2024-09-21T07:00:22.679467+0000","last_undegraded":"2024-09-21T07:00:22.679467+0000","last_fullsized":"2024-09-21T07:00:22.679467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:58.019313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555503+0000","last_change":"2024-09-21T07:00:20.547960+0000","last_active":"2024-09-21T07:00:22.555503+0000","last_peered":"2024-09-21T07:00:22.555503+0000","last_clean":"2024-09-21T07:00:22.555503+0000","last_became_active":"2024-09-21T07:00:20.546833+0000","last_became_peered":"2024-09-21T07:00:20.546833+0000","last_unstale":"2024-09-21T07:00:22.555503+0000","last_undegraded":"2024-09-21T07:00:22.555503+0000","last_fullsized":"2024-09-21T07:00:22.555503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:37.528194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559865+0000","last_change":"2024-09-21T07:00:21.563091+0000","last_active":"2024-09-21T07:00:22.559865+0000","last_peered":"2024-09-21T07:00:22.559865+0000","last_clean":"2024-09-21T07:00:22.559865+0000","last_became_active":"2024-09-21T07:00:21.562811+0000","last_became_peered":"2024-09-21T07:00:21.562811+0000","last_unstale":"2024-09-21T07:00:22.559865+0000","last_undegraded":"2024-09-21T07:00:22.559865+0000","last_fullsized":"2024-09-21T07:00:22.559865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:49.171420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678235+0000","last_change":"2024-09-21T07:00:20.545659+0000","last_active":"2024-09-21T07:00:22.678235+0000","last_peered":"2024-09-21T07:00:22.678235+0000","last_clean":"2024-09-21T07:00:22.678235+0000","last_became_active":"2024-09-21T07:00:20.545366+0000","last_became_peered":"2024-09-21T07:00:20.545366+0000","last_unstale":"2024-09-21T07:00:22.678235+0000","last_undegraded":"2024-09-21T07:00:22.678235+0000","last_fullsized":"2024-09-21T07:00:22.678235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:22.996288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559756+0000","last_change":"2024-09-21T07:00:21.565942+0000","last_active":"2024-09-21T07:00:22.559756+0000","last_peered":"2024-09-21T07:00:22.559756+0000","last_clean":"2024-09-21T07:00:22.559756+0000","last_became_active":"2024-09-21T07:00:21.565056+0000","last_became_peered":"2024-09-21T07:00:21.565056+0000","last_unstale":"2024-09-21T07:00:22.559756+0000","last_undegraded":"2024-09-21T07:00:22.559756+0000","last_fullsized":"2024-09-21T07:00:22.559756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:09.565013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678861+0000","last_change":"2024-09-21T07:00:20.554660+0000","last_active":"2024-09-21T07:00:22.678861+0000","last_peered":"2024-09-21T07:00:22.678861+0000","last_clean":"2024-09-21T07:00:22.678861+0000","last_became_active":"2024-09-21T07:00:20.554334+0000","last_became_peered":"2024-09-21T07:00:20.554334+0000","last_unstale":"2024-09-21T07:00:22.678861+0000","last_undegraded":"2024-09-21T07:00:22.678861+0000","last_fullsized":"2024-09-21T07:00:22.678861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:45.606392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680202+0000","last_change":"2024-09-21T07:00:21.555156+0000","last_active":"2024-09-21T07:00:22.680202+0000","last_peered":"2024-09-21T07:00:22.680202+0000","last_clean":"2024-09-21T07:00:22.680202+0000","last_became_active":"2024-09-21T07:00:21.554579+0000","last_became_peered":"2024-09-21T07:00:21.554579+0000","last_unstale":"2024-09-21T07:00:22.680202+0000","last_undegraded":"2024-09-21T07:00:22.680202+0000","last_fullsized":"2024-09-21T07:00:22.680202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:07.081855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679218+0000","last_change":"2024-09-21T07:00:20.551878+0000","last_active":"2024-09-21T07:00:22.679218+0000","last_peered":"2024-09-21T07:00:22.679218+0000","last_clean":"2024-09-21T07:00:22.679218+0000","last_became_active":"2024-09-21T07:00:20.551510+0000","last_became_peered":"2024-09-21T07:00:20.551510+0000","last_unstale":"2024-09-21T07:00:22.679218+0000","last_undegraded":"2024-09-21T07:00:22.679218+0000","last_fullsized":"2024-09-21T07:00:22.679218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:21.053297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555616+0000","last_change":"2024-09-21T07:00:21.557553+0000","last_active":"2024-09-21T07:00:22.555616+0000","last_peered":"2024-09-21T07:00:22.555616+0000","last_clean":"2024-09-21T07:00:22.555616+0000","last_became_active":"2024-09-21T07:00:21.557241+0000","last_became_peered":"2024-09-21T07:00:21.557241+0000","last_unstale":"2024-09-21T07:00:22.555616+0000","last_undegraded":"2024-09-21T07:00:22.555616+0000","last_fullsized":"2024-09-21T07:00:22.555616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:55.968830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559402+0000","last_change":"2024-09-21T07:00:20.556459+0000","last_active":"2024-09-21T07:00:22.559402+0000","last_peered":"2024-09-21T07:00:22.559402+0000","last_clean":"2024-09-21T07:00:22.559402+0000","last_became_active":"2024-09-21T07:00:20.556107+0000","last_became_peered":"2024-09-21T07:00:20.556107+0000","last_unstale":"2024-09-21T07:00:22.559402+0000","last_undegraded":"2024-09-21T07:00:22.559402+0000","last_fullsized":"2024-09-21T07:00:22.559402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:49.233183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679135+0000","last_change":"2024-09-21T07:00:21.560398+0000","last_active":"2024-09-21T07:00:22.679135+0000","last_peered":"2024-09-21T07:00:22.679135+0000","last_clean":"2024-09-21T07:00:22.679135+0000","last_became_active":"2024-09-21T07:00:21.559982+0000","last_became_peered":"2024-09-21T07:00:21.559982+0000","last_unstale":"2024-09-21T07:00:22.679135+0000","last_undegraded":"2024-09-21T07:00:22.679135+0000","last_fullsized":"2024-09-21T07:00:22.679135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:03.253724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679057+0000","last_change":"2024-09-21T07:00:20.550595+0000","last_active":"2024-09-21T07:00:22.679057+0000","last_peered":"2024-09-21T07:00:22.679057+0000","last_clean":"2024-09-21T07:00:22.679057+0000","last_became_active":"2024-09-21T07:00:20.550200+0000","last_became_peered":"2024-09-21T07:00:20.550200+0000","last_unstale":"2024-09-21T07:00:22.679057+0000","last_undegraded":"2024-09-21T07:00:22.679057+0000","last_fullsized":"2024-09-21T07:00:22.679057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:18.707436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679134+0000","last_change":"2024-09-21T07:00:21.560750+0000","last_active":"2024-09-21T07:00:22.679134+0000","last_peered":"2024-09-21T07:00:22.679134+0000","last_clean":"2024-09-21T07:00:22.679134+0000","last_became_active":"2024-09-21T07:00:21.560441+0000","last_became_peered":"2024-09-21T07:00:21.560441+0000","last_unstale":"2024-09-21T07:00:22.679134+0000","last_undegraded":"2024-09-21T07:00:22.679134+0000","last_fullsized":"2024-09-21T07:00:22.679134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.279791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555799+0000","last_change":"2024-09-21T07:00:20.544906+0000","last_active":"2024-09-21T07:00:22.555799+0000","last_peered":"2024-09-21T07:00:22.555799+0000","last_clean":"2024-09-21T07:00:22.555799+0000","last_became_active":"2024-09-21T07:00:20.544498+0000","last_became_peered":"2024-09-21T07:00:20.544498+0000","last_unstale":"2024-09-21T07:00:22.555799+0000","last_undegraded":"2024-09-21T07:00:22.555799+0000","last_fullsized":"2024-09-21T07:00:22.555799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:44.271032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555684+0000","last_change":"2024-09-21T07:00:21.564804+0000","last_active":"2024-09-21T07:00:22.555684+0000","last_peered":"2024-09-21T07:00:22.555684+0000","last_clean":"2024-09-21T07:00:22.555684+0000","last_became_active":"2024-09-21T07:00:21.561696+0000","last_became_peered":"2024-09-21T07:00:21.561696+0000","last_unstale":"2024-09-21T07:00:22.555684+0000","last_undegraded":"2024-09-21T07:00:22.555684+0000","last_fullsized":"2024-09-21T07:00:22.555684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:49.943900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678454+0000","last_change":"2024-09-21T07:00:20.557556+0000","last_active":"2024-09-21T07:00:22.678454+0000","last_peered":"2024-09-21T07:00:22.678454+0000","last_clean":"2024-09-21T07:00:22.678454+0000","last_became_active":"2024-09-21T07:00:20.557169+0000","last_became_peered":"2024-09-21T07:00:20.557169+0000","last_unstale":"2024-09-21T07:00:22.678454+0000","last_undegraded":"2024-09-21T07:00:22.678454+0000","last_fullsized":"2024-09-21T07:00:22.678454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:17.973920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678272+0000","last_change":"2024-09-21T07:00:21.561779+0000","last_active":"2024-09-21T07:00:22.678272+0000","last_peered":"2024-09-21T07:00:22.678272+0000","last_clean":"2024-09-21T07:00:22.678272+0000","last_became_active":"2024-09-21T07:00:21.559267+0000","last_became_peered":"2024-09-21T07:00:21.559267+0000","last_unstale":"2024-09-21T07:00:22.678272+0000","last_undegraded":"2024-09-21T07:00:22.678272+0000","last_fullsized":"2024-09-21T07:00:22.678272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:30.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559457+0000","last_change":"2024-09-21T07:00:20.549484+0000","last_active":"2024-09-21T07:00:22.559457+0000","last_peered":"2024-09-21T07:00:22.559457+0000","last_clean":"2024-09-21T07:00:22.559457+0000","last_became_active":"2024-09-21T07:00:20.549138+0000","last_became_peered":"2024-09-21T07:00:20.549138+0000","last_unstale":"2024-09-21T07:00:22.559457+0000","last_undegraded":"2024-09-21T07:00:22.559457+0000","last_fullsized":"2024-09-21T07:00:22.559457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:49.823889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555525+0000","last_change":"2024-09-21T07:00:21.553588+0000","last_active":"2024-09-21T07:00:22.555525+0000","last_peered":"2024-09-21T07:00:22.555525+0000","last_clean":"2024-09-21T07:00:22.555525+0000","last_became_active":"2024-09-21T07:00:21.553198+0000","last_became_peered":"2024-09-21T07:00:21.553198+0000","last_unstale":"2024-09-21T07:00:22.555525+0000","last_undegraded":"2024-09-21T07:00:22.555525+0000","last_fullsized":"2024-09-21T07:00:22.555525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:10.283749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679331+0000","last_change":"2024-09-21T07:00:20.556500+0000","last_active":"2024-09-21T07:00:22.679331+0000","last_peered":"2024-09-21T07:00:22.679331+0000","last_clean":"2024-09-21T07:00:22.679331+0000","last_became_active":"2024-09-21T07:00:20.556193+0000","last_became_peered":"2024-09-21T07:00:20.556193+0000","last_unstale":"2024-09-21T07:00:22.679331+0000","last_undegraded":"2024-09-21T07:00:22.679331+0000","last_fullsized":"2024-09-21T07:00:22.679331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:58.055286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559733+0000","last_change":"2024-09-21T07:00:21.565347+0000","last_active":"2024-09-21T07:00:22.559733+0000","last_peered":"2024-09-21T07:00:22.559733+0000","last_clean":"2024-09-21T07:00:22.559733+0000","last_became_active":"2024-09-21T07:00:21.565023+0000","last_became_peered":"2024-09-21T07:00:21.565023+0000","last_unstale":"2024-09-21T07:00:22.559733+0000","last_undegraded":"2024-09-21T07:00:22.559733+0000","last_fullsized":"2024-09-21T07:00:22.559733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:45.276577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559893+0000","last_change":"2024-09-21T07:00:20.546640+0000","last_active":"2024-09-21T07:00:22.559893+0000","last_peered":"2024-09-21T07:00:22.559893+0000","last_clean":"2024-09-21T07:00:22.559893+0000","last_became_active":"2024-09-21T07:00:20.545583+0000","last_became_peered":"2024-09-21T07:00:20.545583+0000","last_unstale":"2024-09-21T07:00:22.559893+0000","last_undegraded":"2024-09-21T07:00:22.559893+0000","last_fullsized":"2024-09-21T07:00:22.559893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:24.006199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679347+0000","last_change":"2024-09-21T07:00:21.562929+0000","last_active":"2024-09-21T07:00:22.679347+0000","last_peered":"2024-09-21T07:00:22.679347+0000","last_clean":"2024-09-21T07:00:22.679347+0000","last_became_active":"2024-09-21T07:00:21.560634+0000","last_became_peered":"2024-09-21T07:00:21.560634+0000","last_unstale":"2024-09-21T07:00:22.679347+0000","last_undegraded":"2024-09-21T07:00:22.679347+0000","last_fullsized":"2024-09-21T07:00:22.679347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:55.968830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679904+0000","last_change":"2024-09-21T07:00:20.547808+0000","last_active":"2024-09-21T07:00:22.679904+0000","last_peered":"2024-09-21T07:00:22.679904+0000","last_clean":"2024-09-21T07:00:22.679904+0000","last_became_active":"2024-09-21T07:00:20.547399+0000","last_became_peered":"2024-09-21T07:00:20.547399+0000","last_unstale":"2024-09-21T07:00:22.679904+0000","last_undegraded":"2024-09-21T07:00:22.679904+0000","last_fullsized":"2024-09-21T07:00:22.679904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:31.765643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679015+0000","last_change":"2024-09-21T07:00:21.565188+0000","last_active":"2024-09-21T07:00:22.679015+0000","last_peered":"2024-09-21T07:00:22.679015+0000","last_clean":"2024-09-21T07:00:22.679015+0000","last_became_active":"2024-09-21T07:00:21.564511+0000","last_became_peered":"2024-09-21T07:00:21.564511+0000","last_unstale":"2024-09-21T07:00:22.679015+0000","last_undegraded":"2024-09-21T07:00:22.679015+0000","last_fullsized":"2024-09-21T07:00:22.679015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:11.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679575+0000","last_change":"2024-09-21T07:00:20.559723+0000","last_active":"2024-09-21T07:00:22.679575+0000","last_peered":"2024-09-21T07:00:22.679575+0000","last_clean":"2024-09-21T07:00:22.679575+0000","last_became_active":"2024-09-21T07:00:20.559395+0000","last_became_peered":"2024-09-21T07:00:20.559395+0000","last_unstale":"2024-09-21T07:00:22.679575+0000","last_undegraded":"2024-09-21T07:00:22.679575+0000","last_fullsized":"2024-09-21T07:00:22.679575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:11.305896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556037+0000","last_change":"2024-09-21T07:00:21.555249+0000","last_active":"2024-09-21T07:00:22.556037+0000","last_peered":"2024-09-21T07:00:22.556037+0000","last_clean":"2024-09-21T07:00:22.556037+0000","last_became_active":"2024-09-21T07:00:21.554923+0000","last_became_peered":"2024-09-21T07:00:21.554923+0000","last_unstale":"2024-09-21T07:00:22.556037+0000","last_undegraded":"2024-09-21T07:00:22.556037+0000","last_fullsized":"2024-09-21T07:00:22.556037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:35.387921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.677846+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:00:22.677846+0000","last_peered":"2024-09-21T07:00:22.677846+0000","last_clean":"2024-09-21T07:00:22.677846+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:00:22.677846+0000","last_undegraded":"2024-09-21T07:00:22.677846+0000","last_fullsized":"2024-09-21T07:00:22.677846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555751+0000","last_change":"2024-09-21T07:00:20.553179+0000","last_active":"2024-09-21T07:00:22.555751+0000","last_peered":"2024-09-21T07:00:22.555751+0000","last_clean":"2024-09-21T07:00:22.555751+0000","last_became_active":"2024-09-21T07:00:20.552827+0000","last_became_peered":"2024-09-21T07:00:20.552827+0000","last_unstale":"2024-09-21T07:00:22.555751+0000","last_undegraded":"2024-09-21T07:00:22.555751+0000","last_fullsized":"2024-09-21T07:00:22.555751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:08.559468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560027+0000","last_change":"2024-09-21T07:00:21.555846+0000","last_active":"2024-09-21T07:00:22.560027+0000","last_peered":"2024-09-21T07:00:22.560027+0000","last_clean":"2024-09-21T07:00:22.560027+0000","last_became_active":"2024-09-21T07:00:21.555489+0000","last_became_peered":"2024-09-21T07:00:21.555489+0000","last_unstale":"2024-09-21T07:00:22.560027+0000","last_undegraded":"2024-09-21T07:00:22.560027+0000","last_fullsized":"2024-09-21T07:00:22.560027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:46.262263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555611+0000","last_change":"2024-09-21T07:00:20.548323+0000","last_active":"2024-09-21T07:00:22.555611+0000","last_peered":"2024-09-21T07:00:22.555611+0000","last_clean":"2024-09-21T07:00:22.555611+0000","last_became_active":"2024-09-21T07:00:20.547621+0000","last_became_peered":"2024-09-21T07:00:20.547621+0000","last_unstale":"2024-09-21T07:00:22.555611+0000","last_undegraded":"2024-09-21T07:00:22.555611+0000","last_fullsized":"2024-09-21T07:00:22.555611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:55.956461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679034+0000","last_change":"2024-09-21T07:00:21.551894+0000","last_active":"2024-09-21T07:00:22.679034+0000","last_peered":"2024-09-21T07:00:22.679034+0000","last_clean":"2024-09-21T07:00:22.679034+0000","last_became_active":"2024-09-21T07:00:21.551591+0000","last_became_peered":"2024-09-21T07:00:21.551591+0000","last_unstale":"2024-09-21T07:00:22.679034+0000","last_undegraded":"2024-09-21T07:00:22.679034+0000","last_fullsized":"2024-09-21T07:00:22.679034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:47.346271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678891+0000","last_change":"2024-09-21T07:00:20.547964+0000","last_active":"2024-09-21T07:00:22.678891+0000","last_peered":"2024-09-21T07:00:22.678891+0000","last_clean":"2024-09-21T07:00:22.678891+0000","last_became_active":"2024-09-21T07:00:20.547608+0000","last_became_peered":"2024-09-21T07:00:20.547608+0000","last_unstale":"2024-09-21T07:00:22.678891+0000","last_undegraded":"2024-09-21T07:00:22.678891+0000","last_fullsized":"2024-09-21T07:00:22.678891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:22.996288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680136+0000","last_change":"2024-09-21T07:00:21.561842+0000","last_active":"2024-09-21T07:00:22.680136+0000","last_peered":"2024-09-21T07:00:22.680136+0000","last_clean":"2024-09-21T07:00:22.680136+0000","last_became_active":"2024-09-21T07:00:21.561384+0000","last_became_peered":"2024-09-21T07:00:21.561384+0000","last_unstale":"2024-09-21T07:00:22.680136+0000","last_undegraded":"2024-09-21T07:00:22.680136+0000","last_fullsized":"2024-09-21T07:00:22.680136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:36.431383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555896+0000","last_change":"2024-09-21T07:00:20.549703+0000","last_active":"2024-09-21T07:00:22.555896+0000","last_peered":"2024-09-21T07:00:22.555896+0000","last_clean":"2024-09-21T07:00:22.555896+0000","last_became_active":"2024-09-21T07:00:20.549357+0000","last_became_peered":"2024-09-21T07:00:20.549357+0000","last_unstale":"2024-09-21T07:00:22.555896+0000","last_undegraded":"2024-09-21T07:00:22.555896+0000","last_fullsized":"2024-09-21T07:00:22.555896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:29.640468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678977+0000","last_change":"2024-09-21T07:00:21.567956+0000","last_active":"2024-09-21T07:00:22.678977+0000","last_peered":"2024-09-21T07:00:22.678977+0000","last_clean":"2024-09-21T07:00:22.678977+0000","last_became_active":"2024-09-21T07:00:21.567178+0000","last_became_peered":"2024-09-21T07:00:21.567178+0000","last_unstale":"2024-09-21T07:00:22.678977+0000","last_undegraded":"2024-09-21T07:00:22.678977+0000","last_fullsized":"2024-09-21T07:00:22.678977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:44.374303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679584+0000","last_change":"2024-09-21T07:00:20.549555+0000","last_active":"2024-09-21T07:00:22.679584+0000","last_peered":"2024-09-21T07:00:22.679584+0000","last_clean":"2024-09-21T07:00:22.679584+0000","last_became_active":"2024-09-21T07:00:20.549225+0000","last_became_peered":"2024-09-21T07:00:20.549225+0000","last_unstale":"2024-09-21T07:00:22.679584+0000","last_undegraded":"2024-09-21T07:00:22.679584+0000","last_fullsized":"2024-09-21T07:00:22.679584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:21.053297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559576+0000","last_change":"2024-09-21T07:00:21.557887+0000","last_active":"2024-09-21T07:00:22.559576+0000","last_peered":"2024-09-21T07:00:22.559576+0000","last_clean":"2024-09-21T07:00:22.559576+0000","last_became_active":"2024-09-21T07:00:21.557553+0000","last_became_peered":"2024-09-21T07:00:21.557553+0000","last_unstale":"2024-09-21T07:00:22.559576+0000","last_undegraded":"2024-09-21T07:00:22.559576+0000","last_fullsized":"2024-09-21T07:00:22.559576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:18.578209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556104+0000","last_change":"2024-09-21T07:00:20.543420+0000","last_active":"2024-09-21T07:00:22.556104+0000","last_peered":"2024-09-21T07:00:22.556104+0000","last_clean":"2024-09-21T07:00:22.556104+0000","last_became_active":"2024-09-21T07:00:20.542474+0000","last_became_peered":"2024-09-21T07:00:20.542474+0000","last_unstale":"2024-09-21T07:00:22.556104+0000","last_undegraded":"2024-09-21T07:00:22.556104+0000","last_fullsized":"2024-09-21T07:00:22.556104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:39.027438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679418+0000","last_change":"2024-09-21T07:00:21.559801+0000","last_active":"2024-09-21T07:00:22.679418+0000","last_peered":"2024-09-21T07:00:22.679418+0000","last_clean":"2024-09-21T07:00:22.679418+0000","last_became_active":"2024-09-21T07:00:21.559042+0000","last_became_peered":"2024-09-21T07:00:21.559042+0000","last_unstale":"2024-09-21T07:00:22.679418+0000","last_undegraded":"2024-09-21T07:00:22.679418+0000","last_fullsized":"2024-09-21T07:00:22.679418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:43.510885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560076+0000","last_change":"2024-09-21T07:00:20.555344+0000","last_active":"2024-09-21T07:00:22.560076+0000","last_peered":"2024-09-21T07:00:22.560076+0000","last_clean":"2024-09-21T07:00:22.560076+0000","last_became_active":"2024-09-21T07:00:20.555062+0000","last_became_peered":"2024-09-21T07:00:20.555062+0000","last_unstale":"2024-09-21T07:00:22.560076+0000","last_undegraded":"2024-09-21T07:00:22.560076+0000","last_fullsized":"2024-09-21T07:00:22.560076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:48.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560218+0000","last_change":"2024-09-21T07:00:21.555637+0000","last_active":"2024-09-21T07:00:22.560218+0000","last_peered":"2024-09-21T07:00:22.560218+0000","last_clean":"2024-09-21T07:00:22.560218+0000","last_became_active":"2024-09-21T07:00:21.554035+0000","last_became_peered":"2024-09-21T07:00:21.554035+0000","last_unstale":"2024-09-21T07:00:22.560218+0000","last_undegraded":"2024-09-21T07:00:22.560218+0000","last_fullsized":"2024-09-21T07:00:22.560218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:32.424218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556233+0000","last_change":"2024-09-21T07:00:20.557912+0000","last_active":"2024-09-21T07:00:22.556233+0000","last_peered":"2024-09-21T07:00:22.556233+0000","last_clean":"2024-09-21T07:00:22.556233+0000","last_became_active":"2024-09-21T07:00:20.557639+0000","last_became_peered":"2024-09-21T07:00:20.557639+0000","last_unstale":"2024-09-21T07:00:22.556233+0000","last_undegraded":"2024-09-21T07:00:22.556233+0000","last_fullsized":"2024-09-21T07:00:22.556233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:58.055286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559735+0000","last_change":"2024-09-21T07:00:21.559146+0000","last_active":"2024-09-21T07:00:22.559735+0000","last_peered":"2024-09-21T07:00:22.559735+0000","last_clean":"2024-09-21T07:00:22.559735+0000","last_became_active":"2024-09-21T07:00:21.558843+0000","last_became_peered":"2024-09-21T07:00:21.558843+0000","last_unstale":"2024-09-21T07:00:22.559735+0000","last_undegraded":"2024-09-21T07:00:22.559735+0000","last_fullsized":"2024-09-21T07:00:22.559735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.986967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.677871+0000","last_change":"2024-09-21T07:00:20.554827+0000","last_active":"2024-09-21T07:00:22.677871+0000","last_peered":"2024-09-21T07:00:22.677871+0000","last_clean":"2024-09-21T07:00:22.677871+0000","last_became_active":"2024-09-21T07:00:20.554492+0000","last_became_peered":"2024-09-21T07:00:20.554492+0000","last_unstale":"2024-09-21T07:00:22.677871+0000","last_undegraded":"2024-09-21T07:00:22.677871+0000","last_fullsized":"2024-09-21T07:00:22.677871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:31.765643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555783+0000","last_change":"2024-09-21T07:00:21.544580+0000","last_active":"2024-09-21T07:00:22.555783+0000","last_peered":"2024-09-21T07:00:22.555783+0000","last_clean":"2024-09-21T07:00:22.555783+0000","last_became_active":"2024-09-21T07:00:21.544183+0000","last_became_peered":"2024-09-21T07:00:21.544183+0000","last_unstale":"2024-09-21T07:00:22.555783+0000","last_undegraded":"2024-09-21T07:00:22.555783+0000","last_fullsized":"2024-09-21T07:00:22.555783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:16.805232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560063+0000","last_change":"2024-09-21T07:00:20.554018+0000","last_active":"2024-09-21T07:00:22.560063+0000","last_peered":"2024-09-21T07:00:22.560063+0000","last_clean":"2024-09-21T07:00:22.560063+0000","last_became_active":"2024-09-21T07:00:20.553671+0000","last_became_peered":"2024-09-21T07:00:20.553671+0000","last_unstale":"2024-09-21T07:00:22.560063+0000","last_undegraded":"2024-09-21T07:00:22.560063+0000","last_fullsized":"2024-09-21T07:00:22.560063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:05.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559563+0000","last_change":"2024-09-21T07:00:21.557634+0000","last_active":"2024-09-21T07:00:22.559563+0000","last_peered":"2024-09-21T07:00:22.559563+0000","last_clean":"2024-09-21T07:00:22.559563+0000","last_became_active":"2024-09-21T07:00:21.557321+0000","last_became_peered":"2024-09-21T07:00:21.557321+0000","last_unstale":"2024-09-21T07:00:22.559563+0000","last_undegraded":"2024-09-21T07:00:22.559563+0000","last_fullsized":"2024-09-21T07:00:22.559563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:30.043686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679867+0000","last_change":"2024-09-21T07:00:20.549405+0000","last_active":"2024-09-21T07:00:22.679867+0000","last_peered":"2024-09-21T07:00:22.679867+0000","last_clean":"2024-09-21T07:00:22.679867+0000","last_became_active":"2024-09-21T07:00:20.549054+0000","last_became_peered":"2024-09-21T07:00:20.549054+0000","last_unstale":"2024-09-21T07:00:22.679867+0000","last_undegraded":"2024-09-21T07:00:22.679867+0000","last_fullsized":"2024-09-21T07:00:22.679867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:33.810421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678789+0000","last_change":"2024-09-21T07:00:21.558561+0000","last_active":"2024-09-21T07:00:22.678789+0000","last_peered":"2024-09-21T07:00:22.678789+0000","last_clean":"2024-09-21T07:00:22.678789+0000","last_became_active":"2024-09-21T07:00:21.558261+0000","last_became_peered":"2024-09-21T07:00:21.558261+0000","last_unstale":"2024-09-21T07:00:22.678789+0000","last_undegraded":"2024-09-21T07:00:22.678789+0000","last_fullsized":"2024-09-21T07:00:22.678789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:59.060831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555611+0000","last_change":"2024-09-21T07:00:20.553936+0000","last_active":"2024-09-21T07:00:22.555611+0000","last_peered":"2024-09-21T07:00:22.555611+0000","last_clean":"2024-09-21T07:00:22.555611+0000","last_became_active":"2024-09-21T07:00:20.553519+0000","last_became_peered":"2024-09-21T07:00:20.553519+0000","last_unstale":"2024-09-21T07:00:22.555611+0000","last_undegraded":"2024-09-21T07:00:22.555611+0000","last_fullsized":"2024-09-21T07:00:22.555611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:45.606392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555730+0000","last_change":"2024-09-21T07:00:21.561189+0000","last_active":"2024-09-21T07:00:22.555730+0000","last_peered":"2024-09-21T07:00:22.555730+0000","last_clean":"2024-09-21T07:00:22.555730+0000","last_became_active":"2024-09-21T07:00:21.560624+0000","last_became_peered":"2024-09-21T07:00:21.560624+0000","last_unstale":"2024-09-21T07:00:22.555730+0000","last_undegraded":"2024-09-21T07:00:22.555730+0000","last_fullsized":"2024-09-21T07:00:22.555730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:18.852711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556021+0000","last_change":"2024-09-21T07:00:21.562747+0000","last_active":"2024-09-21T07:00:22.556021+0000","last_peered":"2024-09-21T07:00:22.556021+0000","last_clean":"2024-09-21T07:00:22.556021+0000","last_became_active":"2024-09-21T07:00:21.561878+0000","last_became_peered":"2024-09-21T07:00:21.561878+0000","last_unstale":"2024-09-21T07:00:22.556021+0000","last_undegraded":"2024-09-21T07:00:22.556021+0000","last_fullsized":"2024-09-21T07:00:22.556021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:55.182037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679152+0000","last_change":"2024-09-21T07:00:20.544327+0000","last_active":"2024-09-21T07:00:22.679152+0000","last_peered":"2024-09-21T07:00:22.679152+0000","last_clean":"2024-09-21T07:00:22.679152+0000","last_became_active":"2024-09-21T07:00:20.542769+0000","last_became_peered":"2024-09-21T07:00:20.542769+0000","last_unstale":"2024-09-21T07:00:22.679152+0000","last_undegraded":"2024-09-21T07:00:22.679152+0000","last_fullsized":"2024-09-21T07:00:22.679152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:29.345084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678441+0000","last_change":"2024-09-21T07:00:21.569453+0000","last_active":"2024-09-21T07:00:22.678441+0000","last_peered":"2024-09-21T07:00:22.678441+0000","last_clean":"2024-09-21T07:00:22.678441+0000","last_became_active":"2024-09-21T07:00:21.569117+0000","last_became_peered":"2024-09-21T07:00:21.569117+0000","last_unstale":"2024-09-21T07:00:22.678441+0000","last_undegraded":"2024-09-21T07:00:22.678441+0000","last_fullsized":"2024-09-21T07:00:22.678441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:56.962006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679022+0000","last_change":"2024-09-21T07:00:20.547783+0000","last_active":"2024-09-21T07:00:22.679022+0000","last_peered":"2024-09-21T07:00:22.679022+0000","last_clean":"2024-09-21T07:00:22.679022+0000","last_became_active":"2024-09-21T07:00:20.547538+0000","last_became_peered":"2024-09-21T07:00:20.547538+0000","last_unstale":"2024-09-21T07:00:22.679022+0000","last_undegraded":"2024-09-21T07:00:22.679022+0000","last_fullsized":"2024-09-21T07:00:22.679022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.323272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680155+0000","last_change":"2024-09-21T07:00:21.557083+0000","last_active":"2024-09-21T07:00:22.680155+0000","last_peered":"2024-09-21T07:00:22.680155+0000","last_clean":"2024-09-21T07:00:22.680155+0000","last_became_active":"2024-09-21T07:00:21.556772+0000","last_became_peered":"2024-09-21T07:00:21.556772+0000","last_unstale":"2024-09-21T07:00:22.680155+0000","last_undegraded":"2024-09-21T07:00:22.680155+0000","last_fullsized":"2024-09-21T07:00:22.680155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:51.527888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680187+0000","last_change":"2024-09-21T07:00:20.543213+0000","last_active":"2024-09-21T07:00:22.680187+0000","last_peered":"2024-09-21T07:00:22.680187+0000","last_clean":"2024-09-21T07:00:22.680187+0000","last_became_active":"2024-09-21T07:00:20.542780+0000","last_became_peered":"2024-09-21T07:00:20.542780+0000","last_unstale":"2024-09-21T07:00:22.680187+0000","last_undegraded":"2024-09-21T07:00:22.680187+0000","last_fullsized":"2024-09-21T07:00:22.680187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.323272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680085+0000","last_change":"2024-09-21T07:00:21.566777+0000","last_active":"2024-09-21T07:00:22.680085+0000","last_peered":"2024-09-21T07:00:22.680085+0000","last_clean":"2024-09-21T07:00:22.680085+0000","last_became_active":"2024-09-21T07:00:21.566472+0000","last_became_peered":"2024-09-21T07:00:21.566472+0000","last_unstale":"2024-09-21T07:00:22.680085+0000","last_undegraded":"2024-09-21T07:00:22.680085+0000","last_fullsized":"2024-09-21T07:00:22.680085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:20.812379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560188+0000","last_change":"2024-09-21T07:00:20.544364+0000","last_active":"2024-09-21T07:00:22.560188+0000","last_peered":"2024-09-21T07:00:22.560188+0000","last_clean":"2024-09-21T07:00:22.560188+0000","last_became_active":"2024-09-21T07:00:20.543152+0000","last_became_peered":"2024-09-21T07:00:20.543152+0000","last_unstale":"2024-09-21T07:00:22.560188+0000","last_undegraded":"2024-09-21T07:00:22.560188+0000","last_fullsized":"2024-09-21T07:00:22.560188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:24.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":823296,"data_stored":667024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":77146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":78176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":78848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:00:33.366 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:00:33.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.518+0000 7f09fa969640 1 -- 172.21.15.63:0/4095515053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09dc004d40 msgr2=0x7f09dc005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:33.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.518+0000 7f09fa969640 1 --2- 172.21.15.63:0/4095515053 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09dc004d40 0x7f09dc005150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c610 tx=0x7f09dc005830 comp rx=0 tx=0).stop 2024-09-21T07:00:33.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.518+0000 7f09f8f06640 1 -- 172.21.15.63:0/4095515053 reap_dead start 2024-09-21T07:00:33.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.518+0000 7f09fa969640 1 -- 172.21.15.63:0/4095515053 shutdown_connections 2024-09-21T07:00:33.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.518+0000 7f09fa969640 1 -- 172.21.15.63:0/4095515053 >> 172.21.15.63:0/4095515053 conn(0x7f09f40d45e0 msgr2=0x7f09f40d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:33.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.518+0000 7f09fa969640 1 -- 172.21.15.63:0/4095515053 shutdown_connections 2024-09-21T07:00:33.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.518+0000 7f09fa969640 1 -- 172.21.15.63:0/4095515053 wait complete. 2024-09-21T07:00:33.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.520+0000 7f09fa969640 1 Processor -- start 2024-09-21T07:00:33.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.520+0000 7f09fa969640 1 -- start start 2024-09-21T07:00:33.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.521+0000 7f09fa969640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09f40b4f30 0x7f09f41f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:33.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09fa969640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f40ca980 0x7f09f41f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:33.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09fa969640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f41f5d20 0x7f09f40cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:33.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09fa969640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f09f406f1c0 con 0x7f09f41f5d20 2024-09-21T07:00:33.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09fa969640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09f406f040 con 0x7f09f40ca980 2024-09-21T07:00:33.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09fa969640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f09f406f340 con 0x7f09f40b4f30 2024-09-21T07:00:33.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f8f06640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f41f5d20 0x7f09f40cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:33.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f8f06640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f41f5d20 0x7f09f40cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37044/0 (socket says 172.21.15.63:37044) 2024-09-21T07:00:33.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f8f06640 1 -- 172.21.15.63:0/234955580 learned_addr learned my addr 172.21.15.63:0/234955580 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:33.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f3fff640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09f40b4f30 0x7f09f41f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f37fe640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f40ca980 0x7f09f41f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f8f06640 1 -- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09f40b4f30 msgr2=0x7f09f41f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f8f06640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09f40b4f30 0x7f09f41f97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f8f06640 1 -- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f40ca980 msgr2=0x7f09f41f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f8f06640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f40ca980 0x7f09f41f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f8f06640 1 -- 172.21.15.63:0/234955580 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f41f9d20 con 0x7f09f41f5d20 2024-09-21T07:00:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f8f06640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f41f5d20 0x7f09f40cdda0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c730 tx=0x7f09ec003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f0ff9640 1 -- 172.21.15.63:0/234955580 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec039070 con 0x7f09f41f5d20 2024-09-21T07:00:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f0ff9640 1 -- 172.21.15.63:0/234955580 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09ec02ba90 con 0x7f09f41f5d20 2024-09-21T07:00:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09fa969640 1 -- 172.21.15.63:0/234955580 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f40cb610 con 0x7f09f41f5d20 2024-09-21T07:00:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09f0ff9640 1 -- 172.21.15.63:0/234955580 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec006180 con 0x7f09f41f5d20 2024-09-21T07:00:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.522+0000 7f09fa969640 1 -- 172.21.15.63:0/234955580 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f40cbb90 con 0x7f09f41f5d20 2024-09-21T07:00:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.523+0000 7f09fa969640 1 -- 172.21.15.63:0/234955580 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f40d2fd0 con 0x7f09f41f5d20 2024-09-21T07:00:33.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.524+0000 7f09f0ff9640 1 -- 172.21.15.63:0/234955580 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f09ec03c020 con 0x7f09f41f5d20 2024-09-21T07:00:33.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.525+0000 7f09f0ff9640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f09e0078b90 0x7f09e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:33.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.525+0000 7f09f0ff9640 1 -- 172.21.15.63:0/234955580 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f09ec0ba4a0 con 0x7f09f41f5d20 2024-09-21T07:00:33.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.525+0000 7f09f3fff640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f09e0078b90 0x7f09e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:33.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.526+0000 7f09f3fff640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f09e0078b90 0x7f09e007b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f09f4162050 tx=0x7f09e4005f30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:33.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.529+0000 7f09f0ff9640 1 -- 172.21.15.63:0/234955580 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f09ec045030 con 0x7f09f41f5d20 2024-09-21T07:00:33.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.714+0000 7f09fa969640 1 -- 172.21.15.63:0/234955580 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09f4075e00 con 0x7f09e0078b90 2024-09-21T07:00:33.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.719+0000 7f09f0ff9640 1 -- 172.21.15.63:0/234955580 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251821 (secure 0 0 0) 0x7f09e405e7c0 con 0x7f09e0078b90 2024-09-21T07:00:33.723 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:33.724 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:00:33.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.722+0000 7f09fa969640 1 -- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f09e0078b90 msgr2=0x7f09e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:33.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.722+0000 7f09fa969640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f09e0078b90 0x7f09e007b0a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f09f4162050 tx=0x7f09e4005f30 comp rx=0 tx=0).stop 2024-09-21T07:00:33.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.722+0000 7f09fa969640 1 -- 172.21.15.63:0/234955580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f41f5d20 msgr2=0x7f09f40cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:33.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.722+0000 7f09fa969640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f41f5d20 0x7f09f40cdda0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c730 tx=0x7f09ec003c60 comp rx=0 tx=0).stop 2024-09-21T07:00:33.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.722+0000 7f09fa969640 1 -- 172.21.15.63:0/234955580 shutdown_connections 2024-09-21T07:00:33.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.722+0000 7f09fa969640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f09e0078b90 0x7f09e007b0a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.722+0000 7f09fa969640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09f41f5d20 0x7f09f40cdda0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.722+0000 7f09fa969640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09f40ca980 0x7f09f41f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.722+0000 7f09fa969640 1 --2- 172.21.15.63:0/234955580 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f09f40b4f30 0x7f09f41f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.722+0000 7f09fa969640 1 -- 172.21.15.63:0/234955580 >> 172.21.15.63:0/234955580 conn(0x7f09f40d45e0 msgr2=0x7f09f406df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:33.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.722+0000 7f09fa969640 1 -- 172.21.15.63:0/234955580 shutdown_connections 2024-09-21T07:00:33.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.722+0000 7f09fa969640 1 -- 172.21.15.63:0/234955580 wait complete. 2024-09-21T07:00:33.735 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-21T07:00:32.600172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219224,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755496,"statfs":{"total":773094113280,"available":772869627904,"internally_reserved":0,"allocated":3022848,"data_stored":1798068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.042455"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679263+0000","last_change":"2024-09-21T07:00:21.563189+0000","last_active":"2024-09-21T07:00:22.679263+0000","last_peered":"2024-09-21T07:00:22.679263+0000","last_clean":"2024-09-21T07:00:22.679263+0000","last_became_active":"2024-09-21T07:00:21.562870+0000","last_became_peered":"2024-09-21T07:00:21.562870+0000","last_unstale":"2024-09-21T07:00:22.679263+0000","last_undegraded":"2024-09-21T07:00:22.679263+0000","last_fullsized":"2024-09-21T07:00:22.679263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:10.283749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679665+0000","last_change":"2024-09-21T07:00:21.562578+0000","last_active":"2024-09-21T07:00:22.679665+0000","last_peered":"2024-09-21T07:00:22.679665+0000","last_clean":"2024-09-21T07:00:22.679665+0000","last_became_active":"2024-09-21T07:00:21.560210+0000","last_became_peered":"2024-09-21T07:00:21.560210+0000","last_unstale":"2024-09-21T07:00:22.679665+0000","last_undegraded":"2024-09-21T07:00:22.679665+0000","last_fullsized":"2024-09-21T07:00:22.679665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:21.843135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679819+0000","last_change":"2024-09-21T07:00:21.558740+0000","last_active":"2024-09-21T07:00:22.679819+0000","last_peered":"2024-09-21T07:00:22.679819+0000","last_clean":"2024-09-21T07:00:22.679819+0000","last_became_active":"2024-09-21T07:00:21.558262+0000","last_became_peered":"2024-09-21T07:00:21.558262+0000","last_unstale":"2024-09-21T07:00:22.679819+0000","last_undegraded":"2024-09-21T07:00:22.679819+0000","last_fullsized":"2024-09-21T07:00:22.679819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:13.795076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559508+0000","last_change":"2024-09-21T07:00:21.572137+0000","last_active":"2024-09-21T07:00:22.559508+0000","last_peered":"2024-09-21T07:00:22.559508+0000","last_clean":"2024-09-21T07:00:22.559508+0000","last_became_active":"2024-09-21T07:00:21.571794+0000","last_became_peered":"2024-09-21T07:00:21.571794+0000","last_unstale":"2024-09-21T07:00:22.559508+0000","last_undegraded":"2024-09-21T07:00:22.559508+0000","last_fullsized":"2024-09-21T07:00:22.559508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:30.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679078+0000","last_change":"2024-09-21T07:00:21.564124+0000","last_active":"2024-09-21T07:00:22.679078+0000","last_peered":"2024-09-21T07:00:22.679078+0000","last_clean":"2024-09-21T07:00:22.679078+0000","last_became_active":"2024-09-21T07:00:21.563782+0000","last_became_peered":"2024-09-21T07:00:21.563782+0000","last_unstale":"2024-09-21T07:00:22.679078+0000","last_undegraded":"2024-09-21T07:00:22.679078+0000","last_fullsized":"2024-09-21T07:00:22.679078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:56.959773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559317+0000","last_change":"2024-09-21T07:00:21.570373+0000","last_active":"2024-09-21T07:00:22.559317+0000","last_peered":"2024-09-21T07:00:22.559317+0000","last_clean":"2024-09-21T07:00:22.559317+0000","last_became_active":"2024-09-21T07:00:21.570032+0000","last_became_peered":"2024-09-21T07:00:21.570032+0000","last_unstale":"2024-09-21T07:00:22.559317+0000","last_undegraded":"2024-09-21T07:00:22.559317+0000","last_fullsized":"2024-09-21T07:00:22.559317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:46.611937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678752+0000","last_change":"2024-09-21T07:00:21.564072+0000","last_active":"2024-09-21T07:00:22.678752+0000","last_peered":"2024-09-21T07:00:22.678752+0000","last_clean":"2024-09-21T07:00:22.678752+0000","last_became_active":"2024-09-21T07:00:21.563740+0000","last_became_peered":"2024-09-21T07:00:21.563740+0000","last_unstale":"2024-09-21T07:00:22.678752+0000","last_undegraded":"2024-09-21T07:00:22.678752+0000","last_fullsized":"2024-09-21T07:00:22.678752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:43.306215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679196+0000","last_change":"2024-09-21T07:00:21.571903+0000","last_active":"2024-09-21T07:00:22.679196+0000","last_peered":"2024-09-21T07:00:22.679196+0000","last_clean":"2024-09-21T07:00:22.679196+0000","last_became_active":"2024-09-21T07:00:21.571504+0000","last_became_peered":"2024-09-21T07:00:21.571504+0000","last_unstale":"2024-09-21T07:00:22.679196+0000","last_undegraded":"2024-09-21T07:00:22.679196+0000","last_fullsized":"2024-09-21T07:00:22.679196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:12.175330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678344+0000","last_change":"2024-09-21T07:00:21.560654+0000","last_active":"2024-09-21T07:00:22.678344+0000","last_peered":"2024-09-21T07:00:22.678344+0000","last_clean":"2024-09-21T07:00:22.678344+0000","last_became_active":"2024-09-21T07:00:21.560359+0000","last_became_peered":"2024-09-21T07:00:21.560359+0000","last_unstale":"2024-09-21T07:00:22.678344+0000","last_undegraded":"2024-09-21T07:00:22.678344+0000","last_fullsized":"2024-09-21T07:00:22.678344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:18.578209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678878+0000","last_change":"2024-09-21T07:00:21.567336+0000","last_active":"2024-09-21T07:00:22.678878+0000","last_peered":"2024-09-21T07:00:22.678878+0000","last_clean":"2024-09-21T07:00:22.678878+0000","last_became_active":"2024-09-21T07:00:21.566797+0000","last_became_peered":"2024-09-21T07:00:21.566797+0000","last_unstale":"2024-09-21T07:00:22.678878+0000","last_undegraded":"2024-09-21T07:00:22.678878+0000","last_fullsized":"2024-09-21T07:00:22.678878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:48:40.090374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678934+0000","last_change":"2024-09-21T07:00:21.563225+0000","last_active":"2024-09-21T07:00:22.678934+0000","last_peered":"2024-09-21T07:00:22.678934+0000","last_clean":"2024-09-21T07:00:22.678934+0000","last_became_active":"2024-09-21T07:00:21.560365+0000","last_became_peered":"2024-09-21T07:00:21.560365+0000","last_unstale":"2024-09-21T07:00:22.678934+0000","last_undegraded":"2024-09-21T07:00:22.678934+0000","last_fullsized":"2024-09-21T07:00:22.678934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:37:39.852924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678783+0000","last_change":"2024-09-21T07:00:21.562837+0000","last_active":"2024-09-21T07:00:22.678783+0000","last_peered":"2024-09-21T07:00:22.678783+0000","last_clean":"2024-09-21T07:00:22.678783+0000","last_became_active":"2024-09-21T07:00:21.560315+0000","last_became_peered":"2024-09-21T07:00:21.560315+0000","last_unstale":"2024-09-21T07:00:22.678783+0000","last_undegraded":"2024-09-21T07:00:22.678783+0000","last_fullsized":"2024-09-21T07:00:22.678783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:34:47.707070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678905+0000","last_change":"2024-09-21T07:00:21.562487+0000","last_active":"2024-09-21T07:00:22.678905+0000","last_peered":"2024-09-21T07:00:22.678905+0000","last_clean":"2024-09-21T07:00:22.678905+0000","last_became_active":"2024-09-21T07:00:21.562191+0000","last_became_peered":"2024-09-21T07:00:21.562191+0000","last_unstale":"2024-09-21T07:00:22.678905+0000","last_undegraded":"2024-09-21T07:00:22.678905+0000","last_fullsized":"2024-09-21T07:00:22.678905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:31:56.671345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678874+0000","last_change":"2024-09-21T07:00:21.553283+0000","last_active":"2024-09-21T07:00:22.678874+0000","last_peered":"2024-09-21T07:00:22.678874+0000","last_clean":"2024-09-21T07:00:22.678874+0000","last_became_active":"2024-09-21T07:00:21.552964+0000","last_became_peered":"2024-09-21T07:00:21.552964+0000","last_unstale":"2024-09-21T07:00:22.678874+0000","last_undegraded":"2024-09-21T07:00:22.678874+0000","last_fullsized":"2024-09-21T07:00:22.678874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:45.103534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678984+0000","last_change":"2024-09-21T07:00:21.571890+0000","last_active":"2024-09-21T07:00:22.678984+0000","last_peered":"2024-09-21T07:00:22.678984+0000","last_clean":"2024-09-21T07:00:22.678984+0000","last_became_active":"2024-09-21T07:00:21.571519+0000","last_became_peered":"2024-09-21T07:00:21.571519+0000","last_unstale":"2024-09-21T07:00:22.678984+0000","last_undegraded":"2024-09-21T07:00:22.678984+0000","last_fullsized":"2024-09-21T07:00:22.678984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:12:02.733307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555427+0000","last_change":"2024-09-21T07:00:21.552279+0000","last_active":"2024-09-21T07:00:22.555427+0000","last_peered":"2024-09-21T07:00:22.555427+0000","last_clean":"2024-09-21T07:00:22.555427+0000","last_became_active":"2024-09-21T07:00:21.551937+0000","last_became_peered":"2024-09-21T07:00:21.551937+0000","last_unstale":"2024-09-21T07:00:22.555427+0000","last_undegraded":"2024-09-21T07:00:22.555427+0000","last_fullsized":"2024-09-21T07:00:22.555427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:03.253724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556346+0000","last_change":"2024-09-21T07:00:21.565756+0000","last_active":"2024-09-21T07:00:22.556346+0000","last_peered":"2024-09-21T07:00:22.556346+0000","last_clean":"2024-09-21T07:00:22.556346+0000","last_became_active":"2024-09-21T07:00:21.565449+0000","last_became_peered":"2024-09-21T07:00:21.565449+0000","last_unstale":"2024-09-21T07:00:22.556346+0000","last_undegraded":"2024-09-21T07:00:22.556346+0000","last_fullsized":"2024-09-21T07:00:22.556346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:54:15.636322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679671+0000","last_change":"2024-09-21T07:00:21.565470+0000","last_active":"2024-09-21T07:00:22.679671+0000","last_peered":"2024-09-21T07:00:22.679671+0000","last_clean":"2024-09-21T07:00:22.679671+0000","last_became_active":"2024-09-21T07:00:21.565119+0000","last_became_peered":"2024-09-21T07:00:21.565119+0000","last_unstale":"2024-09-21T07:00:22.679671+0000","last_undegraded":"2024-09-21T07:00:22.679671+0000","last_fullsized":"2024-09-21T07:00:22.679671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:30.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556259+0000","last_change":"2024-09-21T07:00:21.551138+0000","last_active":"2024-09-21T07:00:22.556259+0000","last_peered":"2024-09-21T07:00:22.556259+0000","last_clean":"2024-09-21T07:00:22.556259+0000","last_became_active":"2024-09-21T07:00:21.550659+0000","last_became_peered":"2024-09-21T07:00:21.550659+0000","last_unstale":"2024-09-21T07:00:22.556259+0000","last_undegraded":"2024-09-21T07:00:22.556259+0000","last_fullsized":"2024-09-21T07:00:22.556259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:52:40.906741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679056+0000","last_change":"2024-09-21T07:00:21.563105+0000","last_active":"2024-09-21T07:00:22.679056+0000","last_peered":"2024-09-21T07:00:22.679056+0000","last_clean":"2024-09-21T07:00:22.679056+0000","last_became_active":"2024-09-21T07:00:21.559949+0000","last_became_peered":"2024-09-21T07:00:21.559949+0000","last_unstale":"2024-09-21T07:00:22.679056+0000","last_undegraded":"2024-09-21T07:00:22.679056+0000","last_fullsized":"2024-09-21T07:00:22.679056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:02.486805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560203+0000","last_change":"2024-09-21T07:00:21.558126+0000","last_active":"2024-09-21T07:00:22.560203+0000","last_peered":"2024-09-21T07:00:22.560203+0000","last_clean":"2024-09-21T07:00:22.560203+0000","last_became_active":"2024-09-21T07:00:21.557784+0000","last_became_peered":"2024-09-21T07:00:21.557784+0000","last_unstale":"2024-09-21T07:00:22.560203+0000","last_undegraded":"2024-09-21T07:00:22.560203+0000","last_fullsized":"2024-09-21T07:00:22.560203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:31:08.303864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678141+0000","last_change":"2024-09-21T07:00:21.564458+0000","last_active":"2024-09-21T07:00:22.678141+0000","last_peered":"2024-09-21T07:00:22.678141+0000","last_clean":"2024-09-21T07:00:22.678141+0000","last_became_active":"2024-09-21T07:00:21.564109+0000","last_became_peered":"2024-09-21T07:00:21.564109+0000","last_unstale":"2024-09-21T07:00:22.678141+0000","last_undegraded":"2024-09-21T07:00:22.678141+0000","last_fullsized":"2024-09-21T07:00:22.678141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:59.060831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679386+0000","last_change":"2024-09-21T07:00:21.565436+0000","last_active":"2024-09-21T07:00:22.679386+0000","last_peered":"2024-09-21T07:00:22.679386+0000","last_clean":"2024-09-21T07:00:22.679386+0000","last_became_active":"2024-09-21T07:00:21.565144+0000","last_became_peered":"2024-09-21T07:00:21.565144+0000","last_unstale":"2024-09-21T07:00:22.679386+0000","last_undegraded":"2024-09-21T07:00:22.679386+0000","last_fullsized":"2024-09-21T07:00:22.679386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:33:22.045462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555426+0000","last_change":"2024-09-21T07:00:21.561626+0000","last_active":"2024-09-21T07:00:22.555426+0000","last_peered":"2024-09-21T07:00:22.555426+0000","last_clean":"2024-09-21T07:00:22.555426+0000","last_became_active":"2024-09-21T07:00:21.561134+0000","last_became_peered":"2024-09-21T07:00:21.561134+0000","last_unstale":"2024-09-21T07:00:22.555426+0000","last_undegraded":"2024-09-21T07:00:22.555426+0000","last_fullsized":"2024-09-21T07:00:22.555426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:14:56.959773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679918+0000","last_change":"2024-09-21T07:00:21.557981+0000","last_active":"2024-09-21T07:00:22.679918+0000","last_peered":"2024-09-21T07:00:22.679918+0000","last_clean":"2024-09-21T07:00:22.679918+0000","last_became_active":"2024-09-21T07:00:21.557675+0000","last_became_peered":"2024-09-21T07:00:21.557675+0000","last_unstale":"2024-09-21T07:00:22.679918+0000","last_undegraded":"2024-09-21T07:00:22.679918+0000","last_fullsized":"2024-09-21T07:00:22.679918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:32:49.917053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559596+0000","last_change":"2024-09-21T07:00:21.566434+0000","last_active":"2024-09-21T07:00:22.559596+0000","last_peered":"2024-09-21T07:00:22.559596+0000","last_clean":"2024-09-21T07:00:22.559596+0000","last_became_active":"2024-09-21T07:00:21.566140+0000","last_became_peered":"2024-09-21T07:00:21.566140+0000","last_unstale":"2024-09-21T07:00:22.559596+0000","last_undegraded":"2024-09-21T07:00:22.559596+0000","last_fullsized":"2024-09-21T07:00:22.559596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:56.962006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680033+0000","last_change":"2024-09-21T07:00:21.554587+0000","last_active":"2024-09-21T07:00:22.680033+0000","last_peered":"2024-09-21T07:00:22.680033+0000","last_clean":"2024-09-21T07:00:22.680033+0000","last_became_active":"2024-09-21T07:00:21.553603+0000","last_became_peered":"2024-09-21T07:00:21.553603+0000","last_unstale":"2024-09-21T07:00:22.680033+0000","last_undegraded":"2024-09-21T07:00:22.680033+0000","last_fullsized":"2024-09-21T07:00:22.680033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:09.948521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679387+0000","last_change":"2024-09-21T07:00:21.563521+0000","last_active":"2024-09-21T07:00:22.679387+0000","last_peered":"2024-09-21T07:00:22.679387+0000","last_clean":"2024-09-21T07:00:22.679387+0000","last_became_active":"2024-09-21T07:00:21.563231+0000","last_became_peered":"2024-09-21T07:00:21.563231+0000","last_unstale":"2024-09-21T07:00:22.679387+0000","last_undegraded":"2024-09-21T07:00:22.679387+0000","last_fullsized":"2024-09-21T07:00:22.679387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:43:09.410925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680038+0000","last_change":"2024-09-21T07:00:21.562180+0000","last_active":"2024-09-21T07:00:22.680038+0000","last_peered":"2024-09-21T07:00:22.680038+0000","last_clean":"2024-09-21T07:00:22.680038+0000","last_became_active":"2024-09-21T07:00:21.561470+0000","last_became_peered":"2024-09-21T07:00:21.561470+0000","last_unstale":"2024-09-21T07:00:22.680038+0000","last_undegraded":"2024-09-21T07:00:22.680038+0000","last_fullsized":"2024-09-21T07:00:22.680038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:14:37.907222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555639+0000","last_change":"2024-09-21T07:00:21.556962+0000","last_active":"2024-09-21T07:00:22.555639+0000","last_peered":"2024-09-21T07:00:22.555639+0000","last_clean":"2024-09-21T07:00:22.555639+0000","last_became_active":"2024-09-21T07:00:21.556476+0000","last_became_peered":"2024-09-21T07:00:21.556476+0000","last_unstale":"2024-09-21T07:00:22.555639+0000","last_undegraded":"2024-09-21T07:00:22.555639+0000","last_fullsized":"2024-09-21T07:00:22.555639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:45.749731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678807+0000","last_change":"2024-09-21T07:00:21.556889+0000","last_active":"2024-09-21T07:00:22.678807+0000","last_peered":"2024-09-21T07:00:22.678807+0000","last_clean":"2024-09-21T07:00:22.678807+0000","last_became_active":"2024-09-21T07:00:21.556591+0000","last_became_peered":"2024-09-21T07:00:21.556591+0000","last_unstale":"2024-09-21T07:00:22.678807+0000","last_undegraded":"2024-09-21T07:00:22.678807+0000","last_fullsized":"2024-09-21T07:00:22.678807+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:46.611937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559221+0000","last_change":"2024-09-21T07:00:21.553852+0000","last_active":"2024-09-21T07:00:22.559221+0000","last_peered":"2024-09-21T07:00:22.559221+0000","last_clean":"2024-09-21T07:00:22.559221+0000","last_became_active":"2024-09-21T07:00:21.553416+0000","last_became_peered":"2024-09-21T07:00:21.553416+0000","last_unstale":"2024-09-21T07:00:22.559221+0000","last_undegraded":"2024-09-21T07:00:22.559221+0000","last_fullsized":"2024-09-21T07:00:22.559221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:59.060831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678185+0000","last_change":"2024-09-21T07:00:21.555826+0000","last_active":"2024-09-21T07:00:22.678185+0000","last_peered":"2024-09-21T07:00:22.678185+0000","last_clean":"2024-09-21T07:00:22.678185+0000","last_became_active":"2024-09-21T07:00:21.555430+0000","last_became_peered":"2024-09-21T07:00:21.555430+0000","last_unstale":"2024-09-21T07:00:22.678185+0000","last_undegraded":"2024-09-21T07:00:22.678185+0000","last_fullsized":"2024-09-21T07:00:22.678185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:46.611937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679918+0000","last_change":"2024-09-21T07:00:20.549521+0000","last_active":"2024-09-21T07:00:22.679918+0000","last_peered":"2024-09-21T07:00:22.679918+0000","last_clean":"2024-09-21T07:00:22.679918+0000","last_became_active":"2024-09-21T07:00:20.549184+0000","last_became_peered":"2024-09-21T07:00:20.549184+0000","last_unstale":"2024-09-21T07:00:22.679918+0000","last_undegraded":"2024-09-21T07:00:22.679918+0000","last_fullsized":"2024-09-21T07:00:22.679918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:18.707436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559636+0000","last_change":"2024-09-21T07:00:21.565217+0000","last_active":"2024-09-21T07:00:22.559636+0000","last_peered":"2024-09-21T07:00:22.559636+0000","last_clean":"2024-09-21T07:00:22.559636+0000","last_became_active":"2024-09-21T07:00:21.564900+0000","last_became_peered":"2024-09-21T07:00:21.564900+0000","last_unstale":"2024-09-21T07:00:22.559636+0000","last_undegraded":"2024-09-21T07:00:22.559636+0000","last_fullsized":"2024-09-21T07:00:22.559636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:54.612942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555720+0000","last_change":"2024-09-21T07:00:20.550510+0000","last_active":"2024-09-21T07:00:22.555720+0000","last_peered":"2024-09-21T07:00:22.555720+0000","last_clean":"2024-09-21T07:00:22.555720+0000","last_became_active":"2024-09-21T07:00:20.550109+0000","last_became_peered":"2024-09-21T07:00:20.550109+0000","last_unstale":"2024-09-21T07:00:22.555720+0000","last_undegraded":"2024-09-21T07:00:22.555720+0000","last_fullsized":"2024-09-21T07:00:22.555720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:17.572663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679063+0000","last_change":"2024-09-21T07:00:20.559604+0000","last_active":"2024-09-21T07:00:22.679063+0000","last_peered":"2024-09-21T07:00:22.679063+0000","last_clean":"2024-09-21T07:00:22.679063+0000","last_became_active":"2024-09-21T07:00:20.559313+0000","last_became_peered":"2024-09-21T07:00:20.559313+0000","last_unstale":"2024-09-21T07:00:22.679063+0000","last_undegraded":"2024-09-21T07:00:22.679063+0000","last_fullsized":"2024-09-21T07:00:22.679063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:35.935572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679467+0000","last_change":"2024-09-21T07:00:21.555824+0000","last_active":"2024-09-21T07:00:22.679467+0000","last_peered":"2024-09-21T07:00:22.679467+0000","last_clean":"2024-09-21T07:00:22.679467+0000","last_became_active":"2024-09-21T07:00:21.554777+0000","last_became_peered":"2024-09-21T07:00:21.554777+0000","last_unstale":"2024-09-21T07:00:22.679467+0000","last_undegraded":"2024-09-21T07:00:22.679467+0000","last_fullsized":"2024-09-21T07:00:22.679467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:58.019313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555503+0000","last_change":"2024-09-21T07:00:20.547960+0000","last_active":"2024-09-21T07:00:22.555503+0000","last_peered":"2024-09-21T07:00:22.555503+0000","last_clean":"2024-09-21T07:00:22.555503+0000","last_became_active":"2024-09-21T07:00:20.546833+0000","last_became_peered":"2024-09-21T07:00:20.546833+0000","last_unstale":"2024-09-21T07:00:22.555503+0000","last_undegraded":"2024-09-21T07:00:22.555503+0000","last_fullsized":"2024-09-21T07:00:22.555503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:37.528194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559865+0000","last_change":"2024-09-21T07:00:21.563091+0000","last_active":"2024-09-21T07:00:22.559865+0000","last_peered":"2024-09-21T07:00:22.559865+0000","last_clean":"2024-09-21T07:00:22.559865+0000","last_became_active":"2024-09-21T07:00:21.562811+0000","last_became_peered":"2024-09-21T07:00:21.562811+0000","last_unstale":"2024-09-21T07:00:22.559865+0000","last_undegraded":"2024-09-21T07:00:22.559865+0000","last_fullsized":"2024-09-21T07:00:22.559865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:49.171420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678235+0000","last_change":"2024-09-21T07:00:20.545659+0000","last_active":"2024-09-21T07:00:22.678235+0000","last_peered":"2024-09-21T07:00:22.678235+0000","last_clean":"2024-09-21T07:00:22.678235+0000","last_became_active":"2024-09-21T07:00:20.545366+0000","last_became_peered":"2024-09-21T07:00:20.545366+0000","last_unstale":"2024-09-21T07:00:22.678235+0000","last_undegraded":"2024-09-21T07:00:22.678235+0000","last_fullsized":"2024-09-21T07:00:22.678235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:22.996288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559756+0000","last_change":"2024-09-21T07:00:21.565942+0000","last_active":"2024-09-21T07:00:22.559756+0000","last_peered":"2024-09-21T07:00:22.559756+0000","last_clean":"2024-09-21T07:00:22.559756+0000","last_became_active":"2024-09-21T07:00:21.565056+0000","last_became_peered":"2024-09-21T07:00:21.565056+0000","last_unstale":"2024-09-21T07:00:22.559756+0000","last_undegraded":"2024-09-21T07:00:22.559756+0000","last_fullsized":"2024-09-21T07:00:22.559756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:09.565013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678861+0000","last_change":"2024-09-21T07:00:20.554660+0000","last_active":"2024-09-21T07:00:22.678861+0000","last_peered":"2024-09-21T07:00:22.678861+0000","last_clean":"2024-09-21T07:00:22.678861+0000","last_became_active":"2024-09-21T07:00:20.554334+0000","last_became_peered":"2024-09-21T07:00:20.554334+0000","last_unstale":"2024-09-21T07:00:22.678861+0000","last_undegraded":"2024-09-21T07:00:22.678861+0000","last_fullsized":"2024-09-21T07:00:22.678861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:45.606392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680202+0000","last_change":"2024-09-21T07:00:21.555156+0000","last_active":"2024-09-21T07:00:22.680202+0000","last_peered":"2024-09-21T07:00:22.680202+0000","last_clean":"2024-09-21T07:00:22.680202+0000","last_became_active":"2024-09-21T07:00:21.554579+0000","last_became_peered":"2024-09-21T07:00:21.554579+0000","last_unstale":"2024-09-21T07:00:22.680202+0000","last_undegraded":"2024-09-21T07:00:22.680202+0000","last_fullsized":"2024-09-21T07:00:22.680202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:10:07.081855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679218+0000","last_change":"2024-09-21T07:00:20.551878+0000","last_active":"2024-09-21T07:00:22.679218+0000","last_peered":"2024-09-21T07:00:22.679218+0000","last_clean":"2024-09-21T07:00:22.679218+0000","last_became_active":"2024-09-21T07:00:20.551510+0000","last_became_peered":"2024-09-21T07:00:20.551510+0000","last_unstale":"2024-09-21T07:00:22.679218+0000","last_undegraded":"2024-09-21T07:00:22.679218+0000","last_fullsized":"2024-09-21T07:00:22.679218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:21.053297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555616+0000","last_change":"2024-09-21T07:00:21.557553+0000","last_active":"2024-09-21T07:00:22.555616+0000","last_peered":"2024-09-21T07:00:22.555616+0000","last_clean":"2024-09-21T07:00:22.555616+0000","last_became_active":"2024-09-21T07:00:21.557241+0000","last_became_peered":"2024-09-21T07:00:21.557241+0000","last_unstale":"2024-09-21T07:00:22.555616+0000","last_undegraded":"2024-09-21T07:00:22.555616+0000","last_fullsized":"2024-09-21T07:00:22.555616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:55.968830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559402+0000","last_change":"2024-09-21T07:00:20.556459+0000","last_active":"2024-09-21T07:00:22.559402+0000","last_peered":"2024-09-21T07:00:22.559402+0000","last_clean":"2024-09-21T07:00:22.559402+0000","last_became_active":"2024-09-21T07:00:20.556107+0000","last_became_peered":"2024-09-21T07:00:20.556107+0000","last_unstale":"2024-09-21T07:00:22.559402+0000","last_undegraded":"2024-09-21T07:00:22.559402+0000","last_fullsized":"2024-09-21T07:00:22.559402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:49.233183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679135+0000","last_change":"2024-09-21T07:00:21.560398+0000","last_active":"2024-09-21T07:00:22.679135+0000","last_peered":"2024-09-21T07:00:22.679135+0000","last_clean":"2024-09-21T07:00:22.679135+0000","last_became_active":"2024-09-21T07:00:21.559982+0000","last_became_peered":"2024-09-21T07:00:21.559982+0000","last_unstale":"2024-09-21T07:00:22.679135+0000","last_undegraded":"2024-09-21T07:00:22.679135+0000","last_fullsized":"2024-09-21T07:00:22.679135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:03.253724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679057+0000","last_change":"2024-09-21T07:00:20.550595+0000","last_active":"2024-09-21T07:00:22.679057+0000","last_peered":"2024-09-21T07:00:22.679057+0000","last_clean":"2024-09-21T07:00:22.679057+0000","last_became_active":"2024-09-21T07:00:20.550200+0000","last_became_peered":"2024-09-21T07:00:20.550200+0000","last_unstale":"2024-09-21T07:00:22.679057+0000","last_undegraded":"2024-09-21T07:00:22.679057+0000","last_fullsized":"2024-09-21T07:00:22.679057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:18.707436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679134+0000","last_change":"2024-09-21T07:00:21.560750+0000","last_active":"2024-09-21T07:00:22.679134+0000","last_peered":"2024-09-21T07:00:22.679134+0000","last_clean":"2024-09-21T07:00:22.679134+0000","last_became_active":"2024-09-21T07:00:21.560441+0000","last_became_peered":"2024-09-21T07:00:21.560441+0000","last_unstale":"2024-09-21T07:00:22.679134+0000","last_undegraded":"2024-09-21T07:00:22.679134+0000","last_fullsized":"2024-09-21T07:00:22.679134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:39.279791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555799+0000","last_change":"2024-09-21T07:00:20.544906+0000","last_active":"2024-09-21T07:00:22.555799+0000","last_peered":"2024-09-21T07:00:22.555799+0000","last_clean":"2024-09-21T07:00:22.555799+0000","last_became_active":"2024-09-21T07:00:20.544498+0000","last_became_peered":"2024-09-21T07:00:20.544498+0000","last_unstale":"2024-09-21T07:00:22.555799+0000","last_undegraded":"2024-09-21T07:00:22.555799+0000","last_fullsized":"2024-09-21T07:00:22.555799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:44.271032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555684+0000","last_change":"2024-09-21T07:00:21.564804+0000","last_active":"2024-09-21T07:00:22.555684+0000","last_peered":"2024-09-21T07:00:22.555684+0000","last_clean":"2024-09-21T07:00:22.555684+0000","last_became_active":"2024-09-21T07:00:21.561696+0000","last_became_peered":"2024-09-21T07:00:21.561696+0000","last_unstale":"2024-09-21T07:00:22.555684+0000","last_undegraded":"2024-09-21T07:00:22.555684+0000","last_fullsized":"2024-09-21T07:00:22.555684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:49.943900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678454+0000","last_change":"2024-09-21T07:00:20.557556+0000","last_active":"2024-09-21T07:00:22.678454+0000","last_peered":"2024-09-21T07:00:22.678454+0000","last_clean":"2024-09-21T07:00:22.678454+0000","last_became_active":"2024-09-21T07:00:20.557169+0000","last_became_peered":"2024-09-21T07:00:20.557169+0000","last_unstale":"2024-09-21T07:00:22.678454+0000","last_undegraded":"2024-09-21T07:00:22.678454+0000","last_fullsized":"2024-09-21T07:00:22.678454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:17.973920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678272+0000","last_change":"2024-09-21T07:00:21.561779+0000","last_active":"2024-09-21T07:00:22.678272+0000","last_peered":"2024-09-21T07:00:22.678272+0000","last_clean":"2024-09-21T07:00:22.678272+0000","last_became_active":"2024-09-21T07:00:21.559267+0000","last_became_peered":"2024-09-21T07:00:21.559267+0000","last_unstale":"2024-09-21T07:00:22.678272+0000","last_undegraded":"2024-09-21T07:00:22.678272+0000","last_fullsized":"2024-09-21T07:00:22.678272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:30.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559457+0000","last_change":"2024-09-21T07:00:20.549484+0000","last_active":"2024-09-21T07:00:22.559457+0000","last_peered":"2024-09-21T07:00:22.559457+0000","last_clean":"2024-09-21T07:00:22.559457+0000","last_became_active":"2024-09-21T07:00:20.549138+0000","last_became_peered":"2024-09-21T07:00:20.549138+0000","last_unstale":"2024-09-21T07:00:22.559457+0000","last_undegraded":"2024-09-21T07:00:22.559457+0000","last_fullsized":"2024-09-21T07:00:22.559457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:52:49.823889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555525+0000","last_change":"2024-09-21T07:00:21.553588+0000","last_active":"2024-09-21T07:00:22.555525+0000","last_peered":"2024-09-21T07:00:22.555525+0000","last_clean":"2024-09-21T07:00:22.555525+0000","last_became_active":"2024-09-21T07:00:21.553198+0000","last_became_peered":"2024-09-21T07:00:21.553198+0000","last_unstale":"2024-09-21T07:00:22.555525+0000","last_undegraded":"2024-09-21T07:00:22.555525+0000","last_fullsized":"2024-09-21T07:00:22.555525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:10.283749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679331+0000","last_change":"2024-09-21T07:00:20.556500+0000","last_active":"2024-09-21T07:00:22.679331+0000","last_peered":"2024-09-21T07:00:22.679331+0000","last_clean":"2024-09-21T07:00:22.679331+0000","last_became_active":"2024-09-21T07:00:20.556193+0000","last_became_peered":"2024-09-21T07:00:20.556193+0000","last_unstale":"2024-09-21T07:00:22.679331+0000","last_undegraded":"2024-09-21T07:00:22.679331+0000","last_fullsized":"2024-09-21T07:00:22.679331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:58.055286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559733+0000","last_change":"2024-09-21T07:00:21.565347+0000","last_active":"2024-09-21T07:00:22.559733+0000","last_peered":"2024-09-21T07:00:22.559733+0000","last_clean":"2024-09-21T07:00:22.559733+0000","last_became_active":"2024-09-21T07:00:21.565023+0000","last_became_peered":"2024-09-21T07:00:21.565023+0000","last_unstale":"2024-09-21T07:00:22.559733+0000","last_undegraded":"2024-09-21T07:00:22.559733+0000","last_fullsized":"2024-09-21T07:00:22.559733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:27:45.276577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559893+0000","last_change":"2024-09-21T07:00:20.546640+0000","last_active":"2024-09-21T07:00:22.559893+0000","last_peered":"2024-09-21T07:00:22.559893+0000","last_clean":"2024-09-21T07:00:22.559893+0000","last_became_active":"2024-09-21T07:00:20.545583+0000","last_became_peered":"2024-09-21T07:00:20.545583+0000","last_unstale":"2024-09-21T07:00:22.559893+0000","last_undegraded":"2024-09-21T07:00:22.559893+0000","last_fullsized":"2024-09-21T07:00:22.559893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:24.006199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679347+0000","last_change":"2024-09-21T07:00:21.562929+0000","last_active":"2024-09-21T07:00:22.679347+0000","last_peered":"2024-09-21T07:00:22.679347+0000","last_clean":"2024-09-21T07:00:22.679347+0000","last_became_active":"2024-09-21T07:00:21.560634+0000","last_became_peered":"2024-09-21T07:00:21.560634+0000","last_unstale":"2024-09-21T07:00:22.679347+0000","last_undegraded":"2024-09-21T07:00:22.679347+0000","last_fullsized":"2024-09-21T07:00:22.679347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:55.968830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679904+0000","last_change":"2024-09-21T07:00:20.547808+0000","last_active":"2024-09-21T07:00:22.679904+0000","last_peered":"2024-09-21T07:00:22.679904+0000","last_clean":"2024-09-21T07:00:22.679904+0000","last_became_active":"2024-09-21T07:00:20.547399+0000","last_became_peered":"2024-09-21T07:00:20.547399+0000","last_unstale":"2024-09-21T07:00:22.679904+0000","last_undegraded":"2024-09-21T07:00:22.679904+0000","last_fullsized":"2024-09-21T07:00:22.679904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:31.765643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679015+0000","last_change":"2024-09-21T07:00:21.565188+0000","last_active":"2024-09-21T07:00:22.679015+0000","last_peered":"2024-09-21T07:00:22.679015+0000","last_clean":"2024-09-21T07:00:22.679015+0000","last_became_active":"2024-09-21T07:00:21.564511+0000","last_became_peered":"2024-09-21T07:00:21.564511+0000","last_unstale":"2024-09-21T07:00:22.679015+0000","last_undegraded":"2024-09-21T07:00:22.679015+0000","last_fullsized":"2024-09-21T07:00:22.679015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:11.678757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679575+0000","last_change":"2024-09-21T07:00:20.559723+0000","last_active":"2024-09-21T07:00:22.679575+0000","last_peered":"2024-09-21T07:00:22.679575+0000","last_clean":"2024-09-21T07:00:22.679575+0000","last_became_active":"2024-09-21T07:00:20.559395+0000","last_became_peered":"2024-09-21T07:00:20.559395+0000","last_unstale":"2024-09-21T07:00:22.679575+0000","last_undegraded":"2024-09-21T07:00:22.679575+0000","last_fullsized":"2024-09-21T07:00:22.679575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:11.305896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556037+0000","last_change":"2024-09-21T07:00:21.555249+0000","last_active":"2024-09-21T07:00:22.556037+0000","last_peered":"2024-09-21T07:00:22.556037+0000","last_clean":"2024-09-21T07:00:22.556037+0000","last_became_active":"2024-09-21T07:00:21.554923+0000","last_became_peered":"2024-09-21T07:00:21.554923+0000","last_unstale":"2024-09-21T07:00:22.556037+0000","last_undegraded":"2024-09-21T07:00:22.556037+0000","last_fullsized":"2024-09-21T07:00:22.556037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:35.387921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.677846+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:00:22.677846+0000","last_peered":"2024-09-21T07:00:22.677846+0000","last_clean":"2024-09-21T07:00:22.677846+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:00:22.677846+0000","last_undegraded":"2024-09-21T07:00:22.677846+0000","last_fullsized":"2024-09-21T07:00:22.677846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555751+0000","last_change":"2024-09-21T07:00:20.553179+0000","last_active":"2024-09-21T07:00:22.555751+0000","last_peered":"2024-09-21T07:00:22.555751+0000","last_clean":"2024-09-21T07:00:22.555751+0000","last_became_active":"2024-09-21T07:00:20.552827+0000","last_became_peered":"2024-09-21T07:00:20.552827+0000","last_unstale":"2024-09-21T07:00:22.555751+0000","last_undegraded":"2024-09-21T07:00:22.555751+0000","last_fullsized":"2024-09-21T07:00:22.555751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:08.559468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560027+0000","last_change":"2024-09-21T07:00:21.555846+0000","last_active":"2024-09-21T07:00:22.560027+0000","last_peered":"2024-09-21T07:00:22.560027+0000","last_clean":"2024-09-21T07:00:22.560027+0000","last_became_active":"2024-09-21T07:00:21.555489+0000","last_became_peered":"2024-09-21T07:00:21.555489+0000","last_unstale":"2024-09-21T07:00:22.560027+0000","last_undegraded":"2024-09-21T07:00:22.560027+0000","last_fullsized":"2024-09-21T07:00:22.560027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:20:46.262263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555611+0000","last_change":"2024-09-21T07:00:20.548323+0000","last_active":"2024-09-21T07:00:22.555611+0000","last_peered":"2024-09-21T07:00:22.555611+0000","last_clean":"2024-09-21T07:00:22.555611+0000","last_became_active":"2024-09-21T07:00:20.547621+0000","last_became_peered":"2024-09-21T07:00:20.547621+0000","last_unstale":"2024-09-21T07:00:22.555611+0000","last_undegraded":"2024-09-21T07:00:22.555611+0000","last_fullsized":"2024-09-21T07:00:22.555611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:55.956461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679034+0000","last_change":"2024-09-21T07:00:21.551894+0000","last_active":"2024-09-21T07:00:22.679034+0000","last_peered":"2024-09-21T07:00:22.679034+0000","last_clean":"2024-09-21T07:00:22.679034+0000","last_became_active":"2024-09-21T07:00:21.551591+0000","last_became_peered":"2024-09-21T07:00:21.551591+0000","last_unstale":"2024-09-21T07:00:22.679034+0000","last_undegraded":"2024-09-21T07:00:22.679034+0000","last_fullsized":"2024-09-21T07:00:22.679034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:47.346271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678891+0000","last_change":"2024-09-21T07:00:20.547964+0000","last_active":"2024-09-21T07:00:22.678891+0000","last_peered":"2024-09-21T07:00:22.678891+0000","last_clean":"2024-09-21T07:00:22.678891+0000","last_became_active":"2024-09-21T07:00:20.547608+0000","last_became_peered":"2024-09-21T07:00:20.547608+0000","last_unstale":"2024-09-21T07:00:22.678891+0000","last_undegraded":"2024-09-21T07:00:22.678891+0000","last_fullsized":"2024-09-21T07:00:22.678891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:22.996288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680136+0000","last_change":"2024-09-21T07:00:21.561842+0000","last_active":"2024-09-21T07:00:22.680136+0000","last_peered":"2024-09-21T07:00:22.680136+0000","last_clean":"2024-09-21T07:00:22.680136+0000","last_became_active":"2024-09-21T07:00:21.561384+0000","last_became_peered":"2024-09-21T07:00:21.561384+0000","last_unstale":"2024-09-21T07:00:22.680136+0000","last_undegraded":"2024-09-21T07:00:22.680136+0000","last_fullsized":"2024-09-21T07:00:22.680136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:06:36.431383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555896+0000","last_change":"2024-09-21T07:00:20.549703+0000","last_active":"2024-09-21T07:00:22.555896+0000","last_peered":"2024-09-21T07:00:22.555896+0000","last_clean":"2024-09-21T07:00:22.555896+0000","last_became_active":"2024-09-21T07:00:20.549357+0000","last_became_peered":"2024-09-21T07:00:20.549357+0000","last_unstale":"2024-09-21T07:00:22.555896+0000","last_undegraded":"2024-09-21T07:00:22.555896+0000","last_fullsized":"2024-09-21T07:00:22.555896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:55:29.640468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678977+0000","last_change":"2024-09-21T07:00:21.567956+0000","last_active":"2024-09-21T07:00:22.678977+0000","last_peered":"2024-09-21T07:00:22.678977+0000","last_clean":"2024-09-21T07:00:22.678977+0000","last_became_active":"2024-09-21T07:00:21.567178+0000","last_became_peered":"2024-09-21T07:00:21.567178+0000","last_unstale":"2024-09-21T07:00:22.678977+0000","last_undegraded":"2024-09-21T07:00:22.678977+0000","last_fullsized":"2024-09-21T07:00:22.678977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:23:44.374303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679584+0000","last_change":"2024-09-21T07:00:20.549555+0000","last_active":"2024-09-21T07:00:22.679584+0000","last_peered":"2024-09-21T07:00:22.679584+0000","last_clean":"2024-09-21T07:00:22.679584+0000","last_became_active":"2024-09-21T07:00:20.549225+0000","last_became_peered":"2024-09-21T07:00:20.549225+0000","last_unstale":"2024-09-21T07:00:22.679584+0000","last_undegraded":"2024-09-21T07:00:22.679584+0000","last_fullsized":"2024-09-21T07:00:22.679584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:57:21.053297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559576+0000","last_change":"2024-09-21T07:00:21.557887+0000","last_active":"2024-09-21T07:00:22.559576+0000","last_peered":"2024-09-21T07:00:22.559576+0000","last_clean":"2024-09-21T07:00:22.559576+0000","last_became_active":"2024-09-21T07:00:21.557553+0000","last_became_peered":"2024-09-21T07:00:21.557553+0000","last_unstale":"2024-09-21T07:00:22.559576+0000","last_undegraded":"2024-09-21T07:00:22.559576+0000","last_fullsized":"2024-09-21T07:00:22.559576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:37:18.578209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556104+0000","last_change":"2024-09-21T07:00:20.543420+0000","last_active":"2024-09-21T07:00:22.556104+0000","last_peered":"2024-09-21T07:00:22.556104+0000","last_clean":"2024-09-21T07:00:22.556104+0000","last_became_active":"2024-09-21T07:00:20.542474+0000","last_became_peered":"2024-09-21T07:00:20.542474+0000","last_unstale":"2024-09-21T07:00:22.556104+0000","last_undegraded":"2024-09-21T07:00:22.556104+0000","last_fullsized":"2024-09-21T07:00:22.556104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:39.027438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679418+0000","last_change":"2024-09-21T07:00:21.559801+0000","last_active":"2024-09-21T07:00:22.679418+0000","last_peered":"2024-09-21T07:00:22.679418+0000","last_clean":"2024-09-21T07:00:22.679418+0000","last_became_active":"2024-09-21T07:00:21.559042+0000","last_became_peered":"2024-09-21T07:00:21.559042+0000","last_unstale":"2024-09-21T07:00:22.679418+0000","last_undegraded":"2024-09-21T07:00:22.679418+0000","last_fullsized":"2024-09-21T07:00:22.679418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:43.510885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560076+0000","last_change":"2024-09-21T07:00:20.555344+0000","last_active":"2024-09-21T07:00:22.560076+0000","last_peered":"2024-09-21T07:00:22.560076+0000","last_clean":"2024-09-21T07:00:22.560076+0000","last_became_active":"2024-09-21T07:00:20.555062+0000","last_became_peered":"2024-09-21T07:00:20.555062+0000","last_unstale":"2024-09-21T07:00:22.560076+0000","last_undegraded":"2024-09-21T07:00:22.560076+0000","last_fullsized":"2024-09-21T07:00:22.560076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:27:48.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560218+0000","last_change":"2024-09-21T07:00:21.555637+0000","last_active":"2024-09-21T07:00:22.560218+0000","last_peered":"2024-09-21T07:00:22.560218+0000","last_clean":"2024-09-21T07:00:22.560218+0000","last_became_active":"2024-09-21T07:00:21.554035+0000","last_became_peered":"2024-09-21T07:00:21.554035+0000","last_unstale":"2024-09-21T07:00:22.560218+0000","last_undegraded":"2024-09-21T07:00:22.560218+0000","last_fullsized":"2024-09-21T07:00:22.560218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:32.424218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556233+0000","last_change":"2024-09-21T07:00:20.557912+0000","last_active":"2024-09-21T07:00:22.556233+0000","last_peered":"2024-09-21T07:00:22.556233+0000","last_clean":"2024-09-21T07:00:22.556233+0000","last_became_active":"2024-09-21T07:00:20.557639+0000","last_became_peered":"2024-09-21T07:00:20.557639+0000","last_unstale":"2024-09-21T07:00:22.556233+0000","last_undegraded":"2024-09-21T07:00:22.556233+0000","last_fullsized":"2024-09-21T07:00:22.556233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:58.055286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559735+0000","last_change":"2024-09-21T07:00:21.559146+0000","last_active":"2024-09-21T07:00:22.559735+0000","last_peered":"2024-09-21T07:00:22.559735+0000","last_clean":"2024-09-21T07:00:22.559735+0000","last_became_active":"2024-09-21T07:00:21.558843+0000","last_became_peered":"2024-09-21T07:00:21.558843+0000","last_unstale":"2024-09-21T07:00:22.559735+0000","last_undegraded":"2024-09-21T07:00:22.559735+0000","last_fullsized":"2024-09-21T07:00:22.559735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:06.986967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.677871+0000","last_change":"2024-09-21T07:00:20.554827+0000","last_active":"2024-09-21T07:00:22.677871+0000","last_peered":"2024-09-21T07:00:22.677871+0000","last_clean":"2024-09-21T07:00:22.677871+0000","last_became_active":"2024-09-21T07:00:20.554492+0000","last_became_peered":"2024-09-21T07:00:20.554492+0000","last_unstale":"2024-09-21T07:00:22.677871+0000","last_undegraded":"2024-09-21T07:00:22.677871+0000","last_fullsized":"2024-09-21T07:00:22.677871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:31.765643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555783+0000","last_change":"2024-09-21T07:00:21.544580+0000","last_active":"2024-09-21T07:00:22.555783+0000","last_peered":"2024-09-21T07:00:22.555783+0000","last_clean":"2024-09-21T07:00:22.555783+0000","last_became_active":"2024-09-21T07:00:21.544183+0000","last_became_peered":"2024-09-21T07:00:21.544183+0000","last_unstale":"2024-09-21T07:00:22.555783+0000","last_undegraded":"2024-09-21T07:00:22.555783+0000","last_fullsized":"2024-09-21T07:00:22.555783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:16.805232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560063+0000","last_change":"2024-09-21T07:00:20.554018+0000","last_active":"2024-09-21T07:00:22.560063+0000","last_peered":"2024-09-21T07:00:22.560063+0000","last_clean":"2024-09-21T07:00:22.560063+0000","last_became_active":"2024-09-21T07:00:20.553671+0000","last_became_peered":"2024-09-21T07:00:20.553671+0000","last_unstale":"2024-09-21T07:00:22.560063+0000","last_undegraded":"2024-09-21T07:00:22.560063+0000","last_fullsized":"2024-09-21T07:00:22.560063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:04:05.471490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.559563+0000","last_change":"2024-09-21T07:00:21.557634+0000","last_active":"2024-09-21T07:00:22.559563+0000","last_peered":"2024-09-21T07:00:22.559563+0000","last_clean":"2024-09-21T07:00:22.559563+0000","last_became_active":"2024-09-21T07:00:21.557321+0000","last_became_peered":"2024-09-21T07:00:21.557321+0000","last_unstale":"2024-09-21T07:00:22.559563+0000","last_undegraded":"2024-09-21T07:00:22.559563+0000","last_fullsized":"2024-09-21T07:00:22.559563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:30.043686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679867+0000","last_change":"2024-09-21T07:00:20.549405+0000","last_active":"2024-09-21T07:00:22.679867+0000","last_peered":"2024-09-21T07:00:22.679867+0000","last_clean":"2024-09-21T07:00:22.679867+0000","last_became_active":"2024-09-21T07:00:20.549054+0000","last_became_peered":"2024-09-21T07:00:20.549054+0000","last_unstale":"2024-09-21T07:00:22.679867+0000","last_undegraded":"2024-09-21T07:00:22.679867+0000","last_fullsized":"2024-09-21T07:00:22.679867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:33.810421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678789+0000","last_change":"2024-09-21T07:00:21.558561+0000","last_active":"2024-09-21T07:00:22.678789+0000","last_peered":"2024-09-21T07:00:22.678789+0000","last_clean":"2024-09-21T07:00:22.678789+0000","last_became_active":"2024-09-21T07:00:21.558261+0000","last_became_peered":"2024-09-21T07:00:21.558261+0000","last_unstale":"2024-09-21T07:00:22.678789+0000","last_undegraded":"2024-09-21T07:00:22.678789+0000","last_fullsized":"2024-09-21T07:00:22.678789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:38:59.060831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555611+0000","last_change":"2024-09-21T07:00:20.553936+0000","last_active":"2024-09-21T07:00:22.555611+0000","last_peered":"2024-09-21T07:00:22.555611+0000","last_clean":"2024-09-21T07:00:22.555611+0000","last_became_active":"2024-09-21T07:00:20.553519+0000","last_became_peered":"2024-09-21T07:00:20.553519+0000","last_unstale":"2024-09-21T07:00:22.555611+0000","last_undegraded":"2024-09-21T07:00:22.555611+0000","last_fullsized":"2024-09-21T07:00:22.555611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:45.606392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.555730+0000","last_change":"2024-09-21T07:00:21.561189+0000","last_active":"2024-09-21T07:00:22.555730+0000","last_peered":"2024-09-21T07:00:22.555730+0000","last_clean":"2024-09-21T07:00:22.555730+0000","last_became_active":"2024-09-21T07:00:21.560624+0000","last_became_peered":"2024-09-21T07:00:21.560624+0000","last_unstale":"2024-09-21T07:00:22.555730+0000","last_undegraded":"2024-09-21T07:00:22.555730+0000","last_fullsized":"2024-09-21T07:00:22.555730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:18.852711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.556021+0000","last_change":"2024-09-21T07:00:21.562747+0000","last_active":"2024-09-21T07:00:22.556021+0000","last_peered":"2024-09-21T07:00:22.556021+0000","last_clean":"2024-09-21T07:00:22.556021+0000","last_became_active":"2024-09-21T07:00:21.561878+0000","last_became_peered":"2024-09-21T07:00:21.561878+0000","last_unstale":"2024-09-21T07:00:22.556021+0000","last_undegraded":"2024-09-21T07:00:22.556021+0000","last_fullsized":"2024-09-21T07:00:22.556021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:01:55.182037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679152+0000","last_change":"2024-09-21T07:00:20.544327+0000","last_active":"2024-09-21T07:00:22.679152+0000","last_peered":"2024-09-21T07:00:22.679152+0000","last_clean":"2024-09-21T07:00:22.679152+0000","last_became_active":"2024-09-21T07:00:20.542769+0000","last_became_peered":"2024-09-21T07:00:20.542769+0000","last_unstale":"2024-09-21T07:00:22.679152+0000","last_undegraded":"2024-09-21T07:00:22.679152+0000","last_fullsized":"2024-09-21T07:00:22.679152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:29.345084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.678441+0000","last_change":"2024-09-21T07:00:21.569453+0000","last_active":"2024-09-21T07:00:22.678441+0000","last_peered":"2024-09-21T07:00:22.678441+0000","last_clean":"2024-09-21T07:00:22.678441+0000","last_became_active":"2024-09-21T07:00:21.569117+0000","last_became_peered":"2024-09-21T07:00:21.569117+0000","last_unstale":"2024-09-21T07:00:22.678441+0000","last_undegraded":"2024-09-21T07:00:22.678441+0000","last_fullsized":"2024-09-21T07:00:22.678441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:56.962006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.679022+0000","last_change":"2024-09-21T07:00:20.547783+0000","last_active":"2024-09-21T07:00:22.679022+0000","last_peered":"2024-09-21T07:00:22.679022+0000","last_clean":"2024-09-21T07:00:22.679022+0000","last_became_active":"2024-09-21T07:00:20.547538+0000","last_became_peered":"2024-09-21T07:00:20.547538+0000","last_unstale":"2024-09-21T07:00:22.679022+0000","last_undegraded":"2024-09-21T07:00:22.679022+0000","last_fullsized":"2024-09-21T07:00:22.679022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.323272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680155+0000","last_change":"2024-09-21T07:00:21.557083+0000","last_active":"2024-09-21T07:00:22.680155+0000","last_peered":"2024-09-21T07:00:22.680155+0000","last_clean":"2024-09-21T07:00:22.680155+0000","last_became_active":"2024-09-21T07:00:21.556772+0000","last_became_peered":"2024-09-21T07:00:21.556772+0000","last_unstale":"2024-09-21T07:00:22.680155+0000","last_undegraded":"2024-09-21T07:00:22.680155+0000","last_fullsized":"2024-09-21T07:00:22.680155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:51.527888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680187+0000","last_change":"2024-09-21T07:00:20.543213+0000","last_active":"2024-09-21T07:00:22.680187+0000","last_peered":"2024-09-21T07:00:22.680187+0000","last_clean":"2024-09-21T07:00:22.680187+0000","last_became_active":"2024-09-21T07:00:20.542780+0000","last_became_peered":"2024-09-21T07:00:20.542780+0000","last_unstale":"2024-09-21T07:00:22.680187+0000","last_undegraded":"2024-09-21T07:00:22.680187+0000","last_fullsized":"2024-09-21T07:00:22.680187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.323272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.680085+0000","last_change":"2024-09-21T07:00:21.566777+0000","last_active":"2024-09-21T07:00:22.680085+0000","last_peered":"2024-09-21T07:00:22.680085+0000","last_clean":"2024-09-21T07:00:22.680085+0000","last_became_active":"2024-09-21T07:00:21.566472+0000","last_became_peered":"2024-09-21T07:00:21.566472+0000","last_unstale":"2024-09-21T07:00:22.680085+0000","last_undegraded":"2024-09-21T07:00:22.680085+0000","last_fullsized":"2024-09-21T07:00:22.680085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:20.523930+0000","last_clean_scrub_stamp":"2024-09-21T07:00:20.523930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:20.812379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T07:00:22.560188+0000","last_change":"2024-09-21T07:00:20.544364+0000","last_active":"2024-09-21T07:00:22.560188+0000","last_peered":"2024-09-21T07:00:22.560188+0000","last_clean":"2024-09-21T07:00:22.560188+0000","last_became_active":"2024-09-21T07:00:20.543152+0000","last_became_peered":"2024-09-21T07:00:20.543152+0000","last_unstale":"2024-09-21T07:00:22.560188+0000","last_undegraded":"2024-09-21T07:00:22.560188+0000","last_fullsized":"2024-09-21T07:00:22.560188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:19.518385+0000","last_clean_scrub_stamp":"2024-09-21T07:00:19.518385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:21:24.823559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":823296,"data_stored":667024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":77146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":78176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":819200,"data_stored":667002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":229376,"data_stored":76620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":78848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:00:33.739 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:00:33.739 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T07:00:33.739 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T07:00:33.739 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T07:00:33.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.889+0000 7f3e0472b640 1 -- 172.21.15.63:0/4080322178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dfc0b7530 msgr2=0x7f3dfc0d2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:33.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.889+0000 7f3e0472b640 1 --2- 172.21.15.63:0/4080322178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dfc0b7530 0x7f3dfc0d2530 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc08cdf0 tx=0x7f3df802a5f0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.889+0000 7f3e0472b640 1 -- 172.21.15.63:0/4080322178 shutdown_connections 2024-09-21T07:00:33.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.889+0000 7f3e0472b640 1 --2- 172.21.15.63:0/4080322178 >> v2:172.21.15.71:3300/0 conn(0x7f3dfc15ef00 0x7f3dfc0d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.889+0000 7f3e0472b640 1 --2- 172.21.15.63:0/4080322178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dfc0b7530 0x7f3dfc0d2530 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.889+0000 7f3e0472b640 1 -- 172.21.15.63:0/4080322178 >> 172.21.15.63:0/4080322178 conn(0x7f3dfc08bfd0 msgr2=0x7f3dfc0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:33.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.889+0000 7f3e0472b640 1 -- 172.21.15.63:0/4080322178 shutdown_connections 2024-09-21T07:00:33.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.889+0000 7f3e0472b640 1 -- 172.21.15.63:0/4080322178 wait complete. 2024-09-21T07:00:33.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.891+0000 7f3e0472b640 1 Processor -- start 2024-09-21T07:00:33.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.891+0000 7f3e0472b640 1 -- start start 2024-09-21T07:00:33.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e0472b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dfc0b2650 0x7f3dfc151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:33.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e0472b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dfc0b7530 0x7f3dfc0ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:33.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e0472b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3dfc15ef00 0x7f3dfc1f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:33.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e0472b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc0b3500 con 0x7f3dfc0b7530 2024-09-21T07:00:33.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e0472b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc0b3380 con 0x7f3dfc0b2650 2024-09-21T07:00:33.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e0472b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3dfc0d5530 con 0x7f3dfc15ef00 2024-09-21T07:00:33.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e01cc6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dfc0b7530 0x7f3dfc0ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:33.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e01cc6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dfc0b7530 0x7f3dfc0ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37056/0 (socket says 172.21.15.63:37056) 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e01cc6640 1 -- 172.21.15.63:0/1980811311 learned_addr learned my addr 172.21.15.63:0/1980811311 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e024c7640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dfc0b2650 0x7f3dfc151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e02cc8640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3dfc15ef00 0x7f3dfc1f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e01cc6640 1 -- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3dfc15ef00 msgr2=0x7f3dfc1f8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e01cc6640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3dfc15ef00 0x7f3dfc1f8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e01cc6640 1 -- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dfc0b2650 msgr2=0x7f3dfc151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e01cc6640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dfc0b2650 0x7f3dfc151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e01cc6640 1 -- 172.21.15.63:0/1980811311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc0cadc0 con 0x7f3dfc0b7530 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.892+0000 7f3e02cc8640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3dfc15ef00 0x7f3dfc1f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.893+0000 7f3e01cc6640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dfc0b7530 0x7f3dfc0ca880 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00e7c0 tx=0x7f3dec00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.893+0000 7f3df2ffd640 1 -- 172.21.15.63:0/1980811311 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec00ccc0 con 0x7f3dfc0b7530 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.893+0000 7f3df2ffd640 1 -- 172.21.15.63:0/1980811311 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dec010430 con 0x7f3dfc0b7530 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.893+0000 7f3e0472b640 1 -- 172.21.15.63:0/1980811311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dfc0b5ce0 con 0x7f3dfc0b7530 2024-09-21T07:00:33.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.893+0000 7f3df2ffd640 1 -- 172.21.15.63:0/1980811311 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec010860 con 0x7f3dfc0b7530 2024-09-21T07:00:33.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.893+0000 7f3e0472b640 1 -- 172.21.15.63:0/1980811311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dfc0b62a0 con 0x7f3dfc0b7530 2024-09-21T07:00:33.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.894+0000 7f3e0472b640 1 -- 172.21.15.63:0/1980811311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dfc0d0660 con 0x7f3dfc0b7530 2024-09-21T07:00:33.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.894+0000 7f3df2ffd640 1 -- 172.21.15.63:0/1980811311 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3dec010a00 con 0x7f3dfc0b7530 2024-09-21T07:00:33.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.895+0000 7f3df2ffd640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3de0078b90 0x7f3de007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:33.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.895+0000 7f3df2ffd640 1 -- 172.21.15.63:0/1980811311 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3dec09b6a0 con 0x7f3dfc0b7530 2024-09-21T07:00:33.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.895+0000 7f3e024c7640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3de0078b90 0x7f3de007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:33.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.896+0000 7f3e024c7640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3de0078b90 0x7f3de007b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3df8034000 tx=0x7f3df8004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:33.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:33.900+0000 7f3df2ffd640 1 -- 172.21.15.63:0/1980811311 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3dec063490 con 0x7f3dfc0b7530 2024-09-21T07:00:34.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.125+0000 7f3e0472b640 1 -- 172.21.15.63:0/1980811311 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3dfc0cb020 con 0x7f3dfc0b7530 2024-09-21T07:00:34.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.125+0000 7f3df2ffd640 1 -- 172.21.15.63:0/1980811311 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3dec067ec0 con 0x7f3dfc0b7530 2024-09-21T07:00:34.127 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:34.127 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T07:00:34.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.128+0000 7f3e0472b640 1 -- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3de0078b90 msgr2=0x7f3de007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.128+0000 7f3e0472b640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3de0078b90 0x7f3de007b0a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3df8034000 tx=0x7f3df8004730 comp rx=0 tx=0).stop 2024-09-21T07:00:34.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.128+0000 7f3e0472b640 1 -- 172.21.15.63:0/1980811311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dfc0b7530 msgr2=0x7f3dfc0ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.128+0000 7f3e0472b640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dfc0b7530 0x7f3dfc0ca880 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00e7c0 tx=0x7f3dec00ec80 comp rx=0 tx=0).stop 2024-09-21T07:00:34.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.128+0000 7f3e0472b640 1 -- 172.21.15.63:0/1980811311 shutdown_connections 2024-09-21T07:00:34.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.128+0000 7f3e0472b640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3de0078b90 0x7f3de007b0a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.128+0000 7f3e0472b640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3dfc15ef00 0x7f3dfc1f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.128+0000 7f3e0472b640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3dfc0b7530 0x7f3dfc0ca880 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.128+0000 7f3e0472b640 1 --2- 172.21.15.63:0/1980811311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3dfc0b2650 0x7f3dfc151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.128+0000 7f3e0472b640 1 -- 172.21.15.63:0/1980811311 >> 172.21.15.63:0/1980811311 conn(0x7f3dfc08bfd0 msgr2=0x7f3dfc15bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:34.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.128+0000 7f3e0472b640 1 -- 172.21.15.63:0/1980811311 shutdown_connections 2024-09-21T07:00:34.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.128+0000 7f3e0472b640 1 -- 172.21.15.63:0/1980811311 wait complete. 2024-09-21T07:00:34.140 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T07:00:34.141 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:00:34.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.255+0000 7fe52d2f2640 1 -- 172.21.15.63:0/2495283402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5280b3750 msgr2=0x7fe52809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.255+0000 7fe52d2f2640 1 --2- 172.21.15.63:0/2495283402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5280b3750 0x7fe52809aa40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe518009be0 tx=0x7fe51802a960 comp rx=0 tx=0).stop 2024-09-21T07:00:34.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.255+0000 7fe52d2f2640 1 -- 172.21.15.63:0/2495283402 shutdown_connections 2024-09-21T07:00:34.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.255+0000 7fe52d2f2640 1 --2- 172.21.15.63:0/2495283402 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5280b3750 0x7fe52809aa40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.255+0000 7fe52d2f2640 1 -- 172.21.15.63:0/2495283402 >> 172.21.15.63:0/2495283402 conn(0x7fe5280b3fb0 msgr2=0x7fe5280b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:34.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.255+0000 7fe52d2f2640 1 -- 172.21.15.63:0/2495283402 shutdown_connections 2024-09-21T07:00:34.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.255+0000 7fe52d2f2640 1 -- 172.21.15.63:0/2495283402 wait complete. 2024-09-21T07:00:34.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.257+0000 7fe52d2f2640 1 Processor -- start 2024-09-21T07:00:34.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.257+0000 7fe52d2f2640 1 -- start start 2024-09-21T07:00:34.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.258+0000 7fe52d2f2640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe52809af80 0x7fe52814b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:34.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.258+0000 7fe52d2f2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5280b3750 0x7fe52814db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:34.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.258+0000 7fe52d2f2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5280b3b60 0x7fe52814e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:34.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.258+0000 7fe52d2f2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe5280b6c00 con 0x7fe5280b3b60 2024-09-21T07:00:34.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.258+0000 7fe52d2f2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe5280b6a80 con 0x7fe5280b3750 2024-09-21T07:00:34.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.258+0000 7fe52d2f2640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe5280b6d80 con 0x7fe52809af80 2024-09-21T07:00:34.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.258+0000 7fe5277fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5280b3b60 0x7fe52814e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:34.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.258+0000 7fe5277fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5280b3b60 0x7fe52814e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37070/0 (socket says 172.21.15.63:37070) 2024-09-21T07:00:34.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.258+0000 7fe5277fe640 1 -- 172.21.15.63:0/3536672274 learned_addr learned my addr 172.21.15.63:0/3536672274 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:34.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.259+0000 7fe526ffd640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe52809af80 0x7fe52814b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:34.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.259+0000 7fe5267fc640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5280b3750 0x7fe52814db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:34.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.259+0000 7fe5277fe640 1 -- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe52809af80 msgr2=0x7fe52814b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.259+0000 7fe5277fe640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe52809af80 0x7fe52814b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.259+0000 7fe5277fe640 1 -- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5280b3750 msgr2=0x7fe52814db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.259+0000 7fe5277fe640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5280b3750 0x7fe52814db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.259+0000 7fe5277fe640 1 -- 172.21.15.63:0/3536672274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe52814bb80 con 0x7fe5280b3b60 2024-09-21T07:00:34.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.259+0000 7fe5277fe640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5280b3b60 0x7fe52814e0b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe52000c3c0 tx=0x7fe52000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:34.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.259+0000 7fe51f7fe640 1 -- 172.21.15.63:0/3536672274 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe520017070 con 0x7fe5280b3b60 2024-09-21T07:00:34.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.259+0000 7fe51f7fe640 1 -- 172.21.15.63:0/3536672274 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe520006d90 con 0x7fe5280b3b60 2024-09-21T07:00:34.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.259+0000 7fe51f7fe640 1 -- 172.21.15.63:0/3536672274 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe520007290 con 0x7fe5280b3b60 2024-09-21T07:00:34.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.259+0000 7fe52d2f2640 1 -- 172.21.15.63:0/3536672274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe52814be60 con 0x7fe5280b3b60 2024-09-21T07:00:34.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.259+0000 7fe52d2f2640 1 -- 172.21.15.63:0/3536672274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe52814c420 con 0x7fe5280b3b60 2024-09-21T07:00:34.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.260+0000 7fe52d2f2640 1 -- 172.21.15.63:0/3536672274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5280b72a0 con 0x7fe5280b3b60 2024-09-21T07:00:34.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.261+0000 7fe51f7fe640 1 -- 172.21.15.63:0/3536672274 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe52001a070 con 0x7fe5280b3b60 2024-09-21T07:00:34.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.261+0000 7fe51f7fe640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe508078b90 0x7fe50807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:34.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.262+0000 7fe51f7fe640 1 -- 172.21.15.63:0/3536672274 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe520099f30 con 0x7fe5280b3b60 2024-09-21T07:00:34.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.262+0000 7fe526ffd640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe508078b90 0x7fe50807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:34.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.262+0000 7fe526ffd640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe508078b90 0x7fe50807b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe518034000 tx=0x7fe518004ab0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:34.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.266+0000 7fe51f7fe640 1 -- 172.21.15.63:0/3536672274 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe52809b390 con 0x7fe5280b3b60 2024-09-21T07:00:34.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.493+0000 7fe52d2f2640 1 -- 172.21.15.63:0/3536672274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5280b2ce0 con 0x7fe5280b3b60 2024-09-21T07:00:34.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.493+0000 7fe51f7fe640 1 -- 172.21.15.63:0/3536672274 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5208 (secure 0 0 0) 0x7fe5280b2ce0 con 0x7fe5280b3b60 2024-09-21T07:00:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:34.495 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-21T07:00:24:568573+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/4041704430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":4041704430},{"type":"v1","addr":"172.21.15.63:6834","nonce":4041704430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1032053510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":1032053510},{"type":"v1","addr":"172.21.15.63:6835","nonce":1032053510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/18747791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":18747791},{"type":"v1","addr":"172.21.15.71:6836","nonce":18747791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:00:20.923025+0000","modified":"2024-09-21T07:00:23.948505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/767391345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":767391345},{"type":"v1","addr":"172.21.15.71:6837","nonce":767391345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T07:00:34.495 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-21T07:00:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.496+0000 7fe52d2f2640 1 -- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe508078b90 msgr2=0x7fe50807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.496+0000 7fe52d2f2640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe508078b90 0x7fe50807b0a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe518034000 tx=0x7fe518004ab0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.496+0000 7fe52d2f2640 1 -- 172.21.15.63:0/3536672274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5280b3b60 msgr2=0x7fe52814e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.496+0000 7fe52d2f2640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5280b3b60 0x7fe52814e0b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe52000c3c0 tx=0x7fe52000c880 comp rx=0 tx=0).stop 2024-09-21T07:00:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.496+0000 7fe52d2f2640 1 -- 172.21.15.63:0/3536672274 shutdown_connections 2024-09-21T07:00:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.496+0000 7fe52d2f2640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe508078b90 0x7fe50807b0a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.496+0000 7fe52d2f2640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5280b3b60 0x7fe52814e0b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.496+0000 7fe52d2f2640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5280b3750 0x7fe52814db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.496+0000 7fe52d2f2640 1 --2- 172.21.15.63:0/3536672274 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe52809af80 0x7fe52814b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.496+0000 7fe52d2f2640 1 -- 172.21.15.63:0/3536672274 >> 172.21.15.63:0/3536672274 conn(0x7fe5280b3fb0 msgr2=0x7fe528072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.496+0000 7fe52d2f2640 1 -- 172.21.15.63:0/3536672274 shutdown_connections 2024-09-21T07:00:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.496+0000 7fe52d2f2640 1 -- 172.21.15.63:0/3536672274 wait complete. 2024-09-21T07:00:34.509 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:00:34.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.623+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/2450329551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f580b3aa0 msgr2=0x7f0f580d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.623+0000 7f0f5eb2b640 1 --2- 172.21.15.63:0/2450329551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f580b3aa0 0x7f0f580d2fd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0f580b3eb0 tx=0x7f0f4802a4b0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.623+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/2450329551 shutdown_connections 2024-09-21T07:00:34.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.623+0000 7f0f5eb2b640 1 --2- 172.21.15.63:0/2450329551 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0f5808c960 0x7f0f580d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.623+0000 7f0f5eb2b640 1 --2- 172.21.15.63:0/2450329551 >> v2:172.21.15.71:3300/0 conn(0x7f0f580b9aa0 0x7f0f580d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.623+0000 7f0f5eb2b640 1 --2- 172.21.15.63:0/2450329551 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f580b3aa0 0x7f0f580d2fd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.623+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/2450329551 >> 172.21.15.63:0/2450329551 conn(0x7f0f580d45e0 msgr2=0x7f0f580d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:34.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.623+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/2450329551 shutdown_connections 2024-09-21T07:00:34.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.623+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/2450329551 wait complete. 2024-09-21T07:00:34.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.625+0000 7f0f5eb2b640 1 Processor -- start 2024-09-21T07:00:34.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.625+0000 7f0f5eb2b640 1 -- start start 2024-09-21T07:00:34.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.626+0000 7f0f5eb2b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5808c960 0x7f0f580c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:34.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.626+0000 7f0f5eb2b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f580b3aa0 0x7f0f580b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:34.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.626+0000 7f0f5eb2b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0f580b9aa0 0x7f0f580b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:34.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.626+0000 7f0f5eb2b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5806ed80 con 0x7f0f580b3aa0 2024-09-21T07:00:34.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.626+0000 7f0f5eb2b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5806ec00 con 0x7f0f5808c960 2024-09-21T07:00:34.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.626+0000 7f0f5eb2b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0f5806ef00 con 0x7f0f580b9aa0 2024-09-21T07:00:34.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.626+0000 7f0f57fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f580b3aa0 0x7f0f580b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.626+0000 7f0f57fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f580b3aa0 0x7f0f580b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37084/0 (socket says 172.21.15.63:37084) 2024-09-21T07:00:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.626+0000 7f0f57fff640 1 -- 172.21.15.63:0/1289671596 learned_addr learned my addr 172.21.15.63:0/1289671596 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.627+0000 7f0f5c8c7640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5808c960 0x7f0f580c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.627+0000 7f0f5d0c8640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0f580b9aa0 0x7f0f580b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.627+0000 7f0f57fff640 1 -- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0f580b9aa0 msgr2=0x7f0f580b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.627+0000 7f0f57fff640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0f580b9aa0 0x7f0f580b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.627+0000 7f0f57fff640 1 -- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5808c960 msgr2=0x7f0f580c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.627+0000 7f0f57fff640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5808c960 0x7f0f580c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.627+0000 7f0f57fff640 1 -- 172.21.15.63:0/1289671596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f580c8100 con 0x7f0f580b3aa0 2024-09-21T07:00:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.627+0000 7f0f57fff640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f580b3aa0 0x7f0f580b5070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c9a0 tx=0x7f0f4000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.627+0000 7f0f557fa640 1 -- 172.21.15.63:0/1289671596 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40007bb0 con 0x7f0f580b3aa0 2024-09-21T07:00:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.627+0000 7f0f557fa640 1 -- 172.21.15.63:0/1289671596 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f40007e40 con 0x7f0f580b3aa0 2024-09-21T07:00:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.627+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/1289671596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f580c83e0 con 0x7f0f580b3aa0 2024-09-21T07:00:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.627+0000 7f0f557fa640 1 -- 172.21.15.63:0/1289671596 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4000f690 con 0x7f0f580b3aa0 2024-09-21T07:00:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.627+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/1289671596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f58156210 con 0x7f0f580b3aa0 2024-09-21T07:00:34.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.628+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/1289671596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f580d2fd0 con 0x7f0f580b3aa0 2024-09-21T07:00:34.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.629+0000 7f0f557fa640 1 -- 172.21.15.63:0/1289671596 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f4000f830 con 0x7f0f580b3aa0 2024-09-21T07:00:34.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.629+0000 7f0f557fa640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0f38078bc0 0x7f0f3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:34.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.630+0000 7f0f557fa640 1 -- 172.21.15.63:0/1289671596 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0f4009b430 con 0x7f0f580b3aa0 2024-09-21T07:00:34.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.630+0000 7f0f5c8c7640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0f38078bc0 0x7f0f3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:34.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.630+0000 7f0f5c8c7640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0f38078bc0 0x7f0f3807b0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f48034000 tx=0x7f0f48004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:34.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.634+0000 7f0f557fa640 1 -- 172.21.15.63:0/1289671596 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0f40014030 con 0x7f0f580b3aa0 2024-09-21T07:00:34.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.861+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/1289671596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f580d1240 con 0x7f0f580b3aa0 2024-09-21T07:00:34.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.862+0000 7f0f557fa640 1 -- 172.21.15.63:0/1289671596 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5208 (secure 0 0 0) 0x7f0f40063220 con 0x7f0f580b3aa0 2024-09-21T07:00:34.863 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:34.864 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-21T07:00:24:568573+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/4041704430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":4041704430},{"type":"v1","addr":"172.21.15.63:6834","nonce":4041704430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1032053510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":1032053510},{"type":"v1","addr":"172.21.15.63:6835","nonce":1032053510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/18747791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":18747791},{"type":"v1","addr":"172.21.15.71:6836","nonce":18747791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:00:20.923025+0000","modified":"2024-09-21T07:00:23.948505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/767391345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":767391345},{"type":"v1","addr":"172.21.15.71:6837","nonce":767391345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T07:00:34.864 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-21T07:00:34.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.864+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0f38078bc0 msgr2=0x7f0f3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.864+0000 7f0f5eb2b640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0f38078bc0 0x7f0f3807b0d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f48034000 tx=0x7f0f48004730 comp rx=0 tx=0).stop 2024-09-21T07:00:34.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.864+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/1289671596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f580b3aa0 msgr2=0x7f0f580b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.864+0000 7f0f5eb2b640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f580b3aa0 0x7f0f580b5070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c9a0 tx=0x7f0f4000ce60 comp rx=0 tx=0).stop 2024-09-21T07:00:34.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.864+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/1289671596 shutdown_connections 2024-09-21T07:00:34.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.864+0000 7f0f5eb2b640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0f38078bc0 0x7f0f3807b0d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.864+0000 7f0f5eb2b640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0f580b9aa0 0x7f0f580b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.864+0000 7f0f5eb2b640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f580b3aa0 0x7f0f580b5070 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.864+0000 7f0f5eb2b640 1 --2- 172.21.15.63:0/1289671596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f5808c960 0x7f0f580c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.864+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/1289671596 >> 172.21.15.63:0/1289671596 conn(0x7f0f580d45e0 msgr2=0x7f0f58075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:34.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.864+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/1289671596 shutdown_connections 2024-09-21T07:00:34.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.864+0000 7f0f5eb2b640 1 -- 172.21.15.63:0/1289671596 wait complete. 2024-09-21T07:00:34.877 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:00:34.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.991+0000 7fc166ee5640 1 -- 172.21.15.63:0/3482480041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1600b3b60 msgr2=0x7fc1600cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.991+0000 7fc166ee5640 1 --2- 172.21.15.63:0/3482480041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1600b3b60 0x7fc1600cd260 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc158005fd0 tx=0x7fc15802a8b0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.991+0000 7fc166ee5640 1 -- 172.21.15.63:0/3482480041 shutdown_connections 2024-09-21T07:00:34.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.991+0000 7fc166ee5640 1 --2- 172.21.15.63:0/3482480041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1600b3b60 0x7fc1600cd260 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.991+0000 7fc166ee5640 1 --2- 172.21.15.63:0/3482480041 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc16009b150 0x7fc1600ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.991+0000 7fc166ee5640 1 -- 172.21.15.63:0/3482480041 >> 172.21.15.63:0/3482480041 conn(0x7fc1600b3fb0 msgr2=0x7fc1600b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:34.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.991+0000 7fc166ee5640 1 -- 172.21.15.63:0/3482480041 shutdown_connections 2024-09-21T07:00:34.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.991+0000 7fc166ee5640 1 -- 172.21.15.63:0/3482480041 wait complete. 2024-09-21T07:00:34.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.992+0000 7fc166ee5640 1 Processor -- start 2024-09-21T07:00:34.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.993+0000 7fc166ee5640 1 -- start start 2024-09-21T07:00:34.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc166ee5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1600b3750 0x7fc16014c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:34.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc166ee5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1600b3b60 0x7fc16014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:34.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc166ee5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc16015d9e0 0x7fc16014d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:34.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc166ee5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc1600cdfa0 con 0x7fc1600b3750 2024-09-21T07:00:34.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc166ee5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc1600cde20 con 0x7fc16015d9e0 2024-09-21T07:00:34.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc166ee5640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc1600ce120 con 0x7fc1600b3b60 2024-09-21T07:00:34.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc164c81640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1600b3750 0x7fc16014c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:34.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc164c81640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1600b3750 0x7fc16014c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37102/0 (socket says 172.21.15.63:37102) 2024-09-21T07:00:34.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc164c81640 1 -- 172.21.15.63:0/2899776512 learned_addr learned my addr 172.21.15.63:0/2899776512 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:34.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc15ffff640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1600b3b60 0x7fc16014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:34.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc165482640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc16015d9e0 0x7fc16014d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:34.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc164c81640 1 -- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1600b3b60 msgr2=0x7fc16014d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc164c81640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1600b3b60 0x7fc16014d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc164c81640 1 -- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc16015d9e0 msgr2=0x7fc16014d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:34.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc164c81640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc16015d9e0 0x7fc16014d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:34.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.994+0000 7fc164c81640 1 -- 172.21.15.63:0/2899776512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16014c900 con 0x7fc1600b3750 2024-09-21T07:00:34.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.995+0000 7fc164c81640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1600b3750 0x7fc16014c1f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc15000c3f0 tx=0x7fc15000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:34.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.995+0000 7fc15d7fa640 1 -- 172.21.15.63:0/2899776512 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150017070 con 0x7fc1600b3750 2024-09-21T07:00:34.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.995+0000 7fc15d7fa640 1 -- 172.21.15.63:0/2899776512 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1500035f0 con 0x7fc1600b3750 2024-09-21T07:00:34.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.995+0000 7fc166ee5640 1 -- 172.21.15.63:0/2899776512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16009ece0 con 0x7fc1600b3750 2024-09-21T07:00:34.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.995+0000 7fc15d7fa640 1 -- 172.21.15.63:0/2899776512 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150003a40 con 0x7fc1600b3750 2024-09-21T07:00:34.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.995+0000 7fc166ee5640 1 -- 172.21.15.63:0/2899776512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16009f2a0 con 0x7fc1600b3750 2024-09-21T07:00:34.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.996+0000 7fc166ee5640 1 -- 172.21.15.63:0/2899776512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc16006a130 con 0x7fc1600b3750 2024-09-21T07:00:35.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.997+0000 7fc15d7fa640 1 -- 172.21.15.63:0/2899776512 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc15001a070 con 0x7fc1600b3750 2024-09-21T07:00:35.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.997+0000 7fc15d7fa640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc14c078b90 0x7fc14c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:35.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.998+0000 7fc15d7fa640 1 -- 172.21.15.63:0/2899776512 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc15009a050 con 0x7fc1600b3750 2024-09-21T07:00:35.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.998+0000 7fc15ffff640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc14c078b90 0x7fc14c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:35.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:34.998+0000 7fc15ffff640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc14c078b90 0x7fc14c07b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc16015dee0 tx=0x7fc154005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:35.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.002+0000 7fc15d7fa640 1 -- 172.21.15.63:0/2899776512 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc150062520 con 0x7fc1600b3750 2024-09-21T07:00:35.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.194+0000 7fc166ee5640 1 -- 172.21.15.63:0/2899776512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc16009bb50 con 0x7fc1600b3750 2024-09-21T07:00:35.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.195+0000 7fc15d7fa640 1 -- 172.21.15.63:0/2899776512 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7fc150061e20 con 0x7fc1600b3750 2024-09-21T07:00:35.197 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:35.197 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:00:22.544759+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:00:18.869431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:00:19.879189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:00:35.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.197+0000 7fc166ee5640 1 -- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc14c078b90 msgr2=0x7fc14c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:35.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.197+0000 7fc166ee5640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc14c078b90 0x7fc14c07b0a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc16015dee0 tx=0x7fc154005f90 comp rx=0 tx=0).stop 2024-09-21T07:00:35.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.197+0000 7fc166ee5640 1 -- 172.21.15.63:0/2899776512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1600b3750 msgr2=0x7fc16014c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:35.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.197+0000 7fc166ee5640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1600b3750 0x7fc16014c1f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc15000c3f0 tx=0x7fc15000c8b0 comp rx=0 tx=0).stop 2024-09-21T07:00:35.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.197+0000 7fc166ee5640 1 -- 172.21.15.63:0/2899776512 shutdown_connections 2024-09-21T07:00:35.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.197+0000 7fc166ee5640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc14c078b90 0x7fc14c07b0a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:35.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.197+0000 7fc166ee5640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc16015d9e0 0x7fc16014d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:35.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.197+0000 7fc166ee5640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1600b3b60 0x7fc16014d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:35.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.197+0000 7fc166ee5640 1 --2- 172.21.15.63:0/2899776512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1600b3750 0x7fc16014c1f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:35.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.197+0000 7fc166ee5640 1 -- 172.21.15.63:0/2899776512 >> 172.21.15.63:0/2899776512 conn(0x7fc1600b3fb0 msgr2=0x7fc160075f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:35.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.197+0000 7fc166ee5640 1 -- 172.21.15.63:0/2899776512 shutdown_connections 2024-09-21T07:00:35.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.197+0000 7fc166ee5640 1 -- 172.21.15.63:0/2899776512 wait complete. 2024-09-21T07:00:35.211 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:00:35.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.325+0000 7f84fe569640 1 -- 172.21.15.63:0/437522469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f80d1300 msgr2=0x7f84f806e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.325+0000 7f84fe569640 1 --2- 172.21.15.63:0/437522469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f80d1300 0x7f84f806e930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f84f806db40 tx=0x7f84f002aa30 comp rx=0 tx=0).stop 2024-09-21T07:00:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.325+0000 7f84fe569640 1 -- 172.21.15.63:0/437522469 shutdown_connections 2024-09-21T07:00:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.325+0000 7f84fe569640 1 --2- 172.21.15.63:0/437522469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f80d1300 0x7f84f806e930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:35.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.325+0000 7f84fe569640 1 --2- 172.21.15.63:0/437522469 >> v2:172.21.15.71:3300/0 conn(0x7f84f80b3aa0 0x7f84f80d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.325+0000 7f84fe569640 1 -- 172.21.15.63:0/437522469 >> 172.21.15.63:0/437522469 conn(0x7f84f80d45e0 msgr2=0x7f84f80d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.325+0000 7f84fe569640 1 -- 172.21.15.63:0/437522469 shutdown_connections 2024-09-21T07:00:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.325+0000 7f84fe569640 1 -- 172.21.15.63:0/437522469 wait complete. 2024-09-21T07:00:35.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.327+0000 7f84fe569640 1 Processor -- start 2024-09-21T07:00:35.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.327+0000 7f84fe569640 1 -- start start 2024-09-21T07:00:35.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.328+0000 7f84fe569640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84f80b3aa0 0x7f84f815dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:35.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.328+0000 7f84fe569640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f80b9aa0 0x7f84f80cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:35.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.328+0000 7f84fe569640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84f815f5d0 0x7f84f815f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:35.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.328+0000 7f84fe569640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f84f80d03d0 con 0x7f84f80b9aa0 2024-09-21T07:00:35.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.328+0000 7f84fe569640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f84f808cb70 con 0x7f84f80b3aa0 2024-09-21T07:00:35.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.328+0000 7f84fe569640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f84f806ee70 con 0x7f84f815f5d0 2024-09-21T07:00:35.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.328+0000 7f84f77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f80b9aa0 0x7f84f80cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:35.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.328+0000 7f84f77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f80b9aa0 0x7f84f80cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37128/0 (socket says 172.21.15.63:37128) 2024-09-21T07:00:35.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.328+0000 7f84f77fe640 1 -- 172.21.15.63:0/860509839 learned_addr learned my addr 172.21.15.63:0/860509839 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:35.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.329+0000 7f84f7fff640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84f80b3aa0 0x7f84f815dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:35.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.329+0000 7f84fcb06640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84f815f5d0 0x7f84f815f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:35.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.329+0000 7f84f77fe640 1 -- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84f815f5d0 msgr2=0x7f84f815f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:35.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.329+0000 7f84f77fe640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84f815f5d0 0x7f84f815f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:35.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.329+0000 7f84f77fe640 1 -- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84f80b3aa0 msgr2=0x7f84f815dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:35.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.329+0000 7f84f77fe640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84f80b3aa0 0x7f84f815dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:35.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.329+0000 7f84f77fe640 1 -- 172.21.15.63:0/860509839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f815ff20 con 0x7f84f80b9aa0 2024-09-21T07:00:35.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.329+0000 7f84f77fe640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f80b9aa0 0x7f84f80cc020 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00c3a0 tx=0x7f84ec00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.329+0000 7f84f4ff9640 1 -- 172.21.15.63:0/860509839 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ec017070 con 0x7f84f80b9aa0 2024-09-21T07:00:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.329+0000 7f84f4ff9640 1 -- 172.21.15.63:0/860509839 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84ec0035f0 con 0x7f84f80b9aa0 2024-09-21T07:00:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.329+0000 7f84fe569640 1 -- 172.21.15.63:0/860509839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f81f5490 con 0x7f84f80b9aa0 2024-09-21T07:00:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.329+0000 7f84f4ff9640 1 -- 172.21.15.63:0/860509839 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ec003a40 con 0x7f84f80b9aa0 2024-09-21T07:00:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.329+0000 7f84fe569640 1 -- 172.21.15.63:0/860509839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f81f5a50 con 0x7f84f80b9aa0 2024-09-21T07:00:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.330+0000 7f84fe569640 1 -- 172.21.15.63:0/860509839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f80cc970 con 0x7f84f80b9aa0 2024-09-21T07:00:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.331+0000 7f84f4ff9640 1 -- 172.21.15.63:0/860509839 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f84ec01a070 con 0x7f84f80b9aa0 2024-09-21T07:00:35.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.332+0000 7f84f4ff9640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f84e4078b90 0x7f84e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.332+0000 7f84f4ff9640 1 -- 172.21.15.63:0/860509839 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f84ec099f50 con 0x7f84f80b9aa0 2024-09-21T07:00:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.332+0000 7f84f7fff640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f84e4078b90 0x7f84e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:35.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.332+0000 7f84f7fff640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f84e4078b90 0x7f84e407b0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009c00 tx=0x7f84e8005f30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:35.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.336+0000 7f84f4ff9640 1 -- 172.21.15.63:0/860509839 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f84f815ff20 con 0x7f84f80b9aa0 2024-09-21T07:00:35.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.561+0000 7f84fe569640 1 -- 172.21.15.63:0/860509839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84f806f2c0 con 0x7f84f80b9aa0 2024-09-21T07:00:35.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.562+0000 7f84f4ff9640 1 -- 172.21.15.63:0/860509839 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5208 (secure 0 0 0) 0x7f84ec061d50 con 0x7f84f80b9aa0 2024-09-21T07:00:35.564 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:35.564 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-21T07:00:24:568573+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/4041704430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":4041704430},{"type":"v1","addr":"172.21.15.63:6834","nonce":4041704430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1032053510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":1032053510},{"type":"v1","addr":"172.21.15.63:6835","nonce":1032053510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/18747791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":18747791},{"type":"v1","addr":"172.21.15.71:6836","nonce":18747791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:00:20.923025+0000","modified":"2024-09-21T07:00:23.948505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/767391345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":767391345},{"type":"v1","addr":"172.21.15.71:6837","nonce":767391345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T07:00:35.564 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-21T07:00:35.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.564+0000 7f84fe569640 1 -- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f84e4078b90 msgr2=0x7f84e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:35.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.564+0000 7f84fe569640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f84e4078b90 0x7f84e407b0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009c00 tx=0x7f84e8005f30 comp rx=0 tx=0).stop 2024-09-21T07:00:35.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.564+0000 7f84fe569640 1 -- 172.21.15.63:0/860509839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f80b9aa0 msgr2=0x7f84f80cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:35.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.564+0000 7f84fe569640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f80b9aa0 0x7f84f80cc020 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00c3a0 tx=0x7f84ec00c860 comp rx=0 tx=0).stop 2024-09-21T07:00:35.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.564+0000 7f84fe569640 1 -- 172.21.15.63:0/860509839 shutdown_connections 2024-09-21T07:00:35.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.564+0000 7f84fe569640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f84e4078b90 0x7f84e407b0a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:35.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.564+0000 7f84fe569640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f84f815f5d0 0x7f84f815f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:35.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.564+0000 7f84fe569640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f80b9aa0 0x7f84f80cc020 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:35.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.564+0000 7f84fe569640 1 --2- 172.21.15.63:0/860509839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f84f80b3aa0 0x7f84f815dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:35.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.564+0000 7f84fe569640 1 -- 172.21.15.63:0/860509839 >> 172.21.15.63:0/860509839 conn(0x7f84f80d45e0 msgr2=0x7f84f815ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:35.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.564+0000 7f84fe569640 1 -- 172.21.15.63:0/860509839 shutdown_connections 2024-09-21T07:00:35.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:35.564+0000 7f84fe569640 1 -- 172.21.15.63:0/860509839 wait complete. 2024-09-21T07:00:35.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:00:20.923025+0000', 'modified': '2024-09-21T07:00:23.948505+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4410}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4410': {'gid': 4410, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.71:6837/767391345', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6835', 'nonce': 767391345}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 767391345}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4410, 'qdb_cluster': [4410]} 2024-09-21T07:00:35.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:00:35.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-21T07:00:36.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.098+0000 7f2e3380a640 1 -- 172.21.15.63:0/196986193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e18003ae0 msgr2=0x7f2e18003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.098+0000 7f2e3380a640 1 --2- 172.21.15.63:0/196986193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e18003ae0 0x7f2e18003f50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009b50 tx=0x7f2e18005830 comp rx=0 tx=0).stop 2024-09-21T07:00:36.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.098+0000 7f2e31da7640 1 -- 172.21.15.63:0/196986193 reap_dead start 2024-09-21T07:00:36.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.098+0000 7f2e3380a640 1 -- 172.21.15.63:0/196986193 shutdown_connections 2024-09-21T07:00:36.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.098+0000 7f2e3380a640 1 -- 172.21.15.63:0/196986193 >> 172.21.15.63:0/196986193 conn(0x7f2e2c0b3fb0 msgr2=0x7f2e2c0b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:36.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.098+0000 7f2e3380a640 1 -- 172.21.15.63:0/196986193 shutdown_connections 2024-09-21T07:00:36.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.098+0000 7f2e3380a640 1 -- 172.21.15.63:0/196986193 wait complete. 2024-09-21T07:00:36.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.100+0000 7f2e3380a640 1 Processor -- start 2024-09-21T07:00:36.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.100+0000 7f2e3380a640 1 -- start start 2024-09-21T07:00:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e3380a640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e18003ae0 0x7f2e2c1f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e3380a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e2c1483e0 0x7f2e2c159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e3380a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e2c159c70 0x7f2e2c148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e3380a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c0ce800 con 0x7f2e2c1483e0 2024-09-21T07:00:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e3380a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c0ce680 con 0x7f2e2c159c70 2024-09-21T07:00:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e3380a640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2e2c0b6730 con 0x7f2e18003ae0 2024-09-21T07:00:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e30da5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e2c1483e0 0x7f2e2c159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e30da5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e2c1483e0 0x7f2e2c159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37140/0 (socket says 172.21.15.63:37140) 2024-09-21T07:00:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e30da5640 1 -- 172.21.15.63:0/1990666453 learned_addr learned my addr 172.21.15.63:0/1990666453 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:36.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e315a6640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e18003ae0 0x7f2e2c1f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e31da7640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e2c159c70 0x7f2e2c148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e30da5640 1 -- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e18003ae0 msgr2=0x7f2e2c1f7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e30da5640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e18003ae0 0x7f2e2c1f7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e30da5640 1 -- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e2c159c70 msgr2=0x7f2e2c148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e30da5640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e2c159c70 0x7f2e2c148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.101+0000 7f2e30da5640 1 -- 172.21.15.63:0/1990666453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c1f7c90 con 0x7f2e2c1483e0 2024-09-21T07:00:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.102+0000 7f2e30da5640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e2c1483e0 0x7f2e2c159730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c006e80 tx=0x7f2e1c0049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.102+0000 7f2e21ffb640 1 -- 172.21.15.63:0/1990666453 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c015020 con 0x7f2e2c1483e0 2024-09-21T07:00:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.102+0000 7f2e21ffb640 1 -- 172.21.15.63:0/1990666453 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e1c010980 con 0x7f2e2c1483e0 2024-09-21T07:00:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.102+0000 7f2e3380a640 1 -- 172.21.15.63:0/1990666453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2c15a080 con 0x7f2e2c1483e0 2024-09-21T07:00:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.102+0000 7f2e21ffb640 1 -- 172.21.15.63:0/1990666453 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c010d90 con 0x7f2e2c1483e0 2024-09-21T07:00:36.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.102+0000 7f2e3380a640 1 -- 172.21.15.63:0/1990666453 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e2c14afa0 con 0x7f2e2c1483e0 2024-09-21T07:00:36.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.104+0000 7f2e21ffb640 1 -- 172.21.15.63:0/1990666453 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2e1c018020 con 0x7f2e2c1483e0 2024-09-21T07:00:36.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.105+0000 7f2e21ffb640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2e10078bc0 0x7f2e1007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.105+0000 7f2e21ffb640 1 -- 172.21.15.63:0/1990666453 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2e1c09b780 con 0x7f2e2c1483e0 2024-09-21T07:00:36.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.105+0000 7f2e315a6640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2e10078bc0 0x7f2e1007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.106+0000 7f2e3a850740 1 Processor -- start 2024-09-21T07:00:36.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.106+0000 7f2e3a850740 1 -- start start 2024-09-21T07:00:36.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.106+0000 7f2e315a6640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2e10078bc0 0x7f2e1007b0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2e28035000 tx=0x7f2e2802d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:36.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e3a850740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b64270 0x5607b8f24970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e3a850740 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f32e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e3a850740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 0x5607b8f333b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e3a850740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5607b8e7e820 con 0x5607b8b43590 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e3a850740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5607b8e6dc50 con 0x5607b8b64270 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e3a850740 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x5607b8e71a60 con 0x5607b8b3b3b0 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e31da7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 0x5607b8f333b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e31da7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 0x5607b8f333b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37152/0 (socket says 172.21.15.63:37152) 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e31da7640 1 -- 172.21.15.63:0/2428987423 learned_addr learned my addr 172.21.15.63:0/2428987423 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e315a6640 1 --2- 172.21.15.63:0/2428987423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b64270 0x5607b8f24970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e30da5640 1 --2- 172.21.15.63:0/2428987423 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f32e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e31da7640 1 -- 172.21.15.63:0/2428987423 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 msgr2=0x5607b8f32e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e31da7640 1 --2- 172.21.15.63:0/2428987423 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f32e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e31da7640 1 -- 172.21.15.63:0/2428987423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b64270 msgr2=0x5607b8f24970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e31da7640 1 --2- 172.21.15.63:0/2428987423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b64270 0x5607b8f24970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e31da7640 1 -- 172.21.15.63:0/2428987423 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607b8bcf850 con 0x5607b8b43590 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.107+0000 7f2e30da5640 1 --2- 172.21.15.63:0/2428987423 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f32e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:36.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.108+0000 7f2e31da7640 1 --2- 172.21.15.63:0/2428987423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 0x5607b8f333b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2e24005fd0 tx=0x7f2e24011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0637f7566ffc12e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.108+0000 7f2e16ffd640 1 -- 172.21.15.63:0/2428987423 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2401f070 con 0x5607b8b43590 2024-09-21T07:00:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.108+0000 7f2e16ffd640 1 -- 172.21.15.63:0/2428987423 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e2401a3f0 con 0x5607b8b43590 2024-09-21T07:00:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.108+0000 7f2e16ffd640 1 -- 172.21.15.63:0/2428987423 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2401a800 con 0x5607b8b43590 2024-09-21T07:00:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.108+0000 7f2e3a850740 1 -- 172.21.15.63:0/2428987423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 msgr2=0x5607b8f333b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.108+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2428987423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 0x5607b8f333b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2e24005fd0 tx=0x7f2e24011810 comp rx=0 tx=0).stop 2024-09-21T07:00:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.108+0000 7f2e3a850740 1 -- 172.21.15.63:0/2428987423 shutdown_connections 2024-09-21T07:00:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.109+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2428987423 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 0x5607b8f333b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.109+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2428987423 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f32e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.109+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2428987423 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b64270 0x5607b8f24970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.109+0000 7f2e3a850740 1 -- 172.21.15.63:0/2428987423 >> 172.21.15.63:0/2428987423 conn(0x5607b8b583c0 msgr2=0x5607b8f0c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.109+0000 7f2e3a850740 1 -- 172.21.15.63:0/2428987423 shutdown_connections 2024-09-21T07:00:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.109+0000 7f2e3a850740 1 -- 172.21.15.63:0/2428987423 wait complete. 2024-09-21T07:00:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.109+0000 7f2e3a850740 1 -- start start 2024-09-21T07:00:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.110+0000 7f2e3a850740 1 Processor -- start 2024-09-21T07:00:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e3a850740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b3b3b0 0x5607b8f65120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e3a850740 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b43590 0x5607b8f4a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e3a850740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b64270 0x5607b8f64670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e3a850740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5607b8bde620 con 0x5607b8b64270 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e3a850740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5607b8e135f0 con 0x5607b8b3b3b0 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e3a850740 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x5607b8f65a20 con 0x5607b8b43590 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e3a850740 10 client.0 _ll_register_callbacks cb 0x5607b8e170a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e31da7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b64270 0x5607b8f64670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e31da7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b64270 0x5607b8f64670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37156/0 (socket says 172.21.15.63:37156) 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e31da7640 1 -- 172.21.15.63:0/2210874427 learned_addr learned my addr 172.21.15.63:0/2210874427 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e30da5640 1 --2- 172.21.15.63:0/2210874427 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b43590 0x5607b8f4a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e315a6640 1 --2- 172.21.15.63:0/2210874427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b3b3b0 0x5607b8f65120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e31da7640 1 -- 172.21.15.63:0/2210874427 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b43590 msgr2=0x5607b8f4a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e31da7640 1 --2- 172.21.15.63:0/2210874427 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b43590 0x5607b8f4a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e31da7640 1 -- 172.21.15.63:0/2210874427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b3b3b0 msgr2=0x5607b8f65120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e31da7640 1 --2- 172.21.15.63:0/2210874427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b3b3b0 0x5607b8f65120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.111+0000 7f2e31da7640 1 -- 172.21.15.63:0/2210874427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607b8c466b0 con 0x5607b8b64270 2024-09-21T07:00:36.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e31da7640 1 --2- 172.21.15.63:0/2210874427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b64270 0x5607b8f64670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0d1a00 tx=0x7f2e2401ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06bcd71c94dcd2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T07:00:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2210874427 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2401f040 con 0x5607b8b64270 2024-09-21T07:00:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2210874427 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2e2401ad80 con 0x5607b8b64270 2024-09-21T07:00:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e3a850740 1 -- 172.21.15.63:0/2210874427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e2401a3f0 con 0x5607b8b64270 2024-09-21T07:00:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2210874427 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f2e24030050 con 0x5607b8b64270 2024-09-21T07:00:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e3a850740 10 client.4710 fetch_fsmap learned FSMap version 8 2024-09-21T07:00:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e3a850740 1 -- 172.21.15.63:0/2210874427 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5607b8f64150 con 0x5607b8b64270 2024-09-21T07:00:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2210874427 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e2401a3f0 con 0x5607b8b64270 2024-09-21T07:00:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2210874427 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f2e24033020 con 0x5607b8b64270 2024-09-21T07:00:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e3a850740 10 client.4710 fetch_fsmap finished waiting for FSMap version 8 2024-09-21T07:00:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e3a850740 10 client.4710 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:00:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e3a850740 20 client.4710 populate_metadata read hostname 'smithi063' 2024-09-21T07:00:36.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2210874427 >> [v2:172.21.15.71:6835/767391345,v1:172.21.15.71:6837/767391345] conn(0x5607b8b22e40 0x5607b8f226f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e3a850740 4 client.4710 mds_command: new command op to 4410 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e3a850740 1 -- 172.21.15.63:0/2210874427 --> [v2:172.21.15.71:6835/767391345,v1:172.21.15.71:6837/767391345] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607b8e80770 con 0x5607b8b22e40 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.112+0000 7f2e315a6640 1 --2- 172.21.15.63:0/2210874427 >> [v2:172.21.15.71:6835/767391345,v1:172.21.15.71:6837/767391345] conn(0x5607b8b22e40 0x5607b8f226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.113+0000 7f2e0bfff640 10 client.4710 ms_handle_connect on v2:172.21.15.71:6835/767391345 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.113+0000 7f2e315a6640 1 --2- 172.21.15.63:0/2210874427 >> [v2:172.21.15.71:6835/767391345,v1:172.21.15.71:6837/767391345] conn(0x5607b8b22e40 0x5607b8f226f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8592488b776aaf61 server_cookie=6eff7815d04db276 in_seq=0 out_seq=0 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2210874427 <== mds.0 v2:172.21.15.71:6835/767391345 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5607b8e80770 con 0x5607b8b22e40 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e0bfff640 10 client.4710 handle_command_reply: tid=0 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e3a850740 1 client.4710 shutdown 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e3a850740 1 -- 172.21.15.63:0/2210874427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b64270 msgr2=0x5607b8f64670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2210874427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b64270 0x5607b8f64670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c0d1a00 tx=0x7f2e2401ab90 comp rx=0 tx=0).stop 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e3a850740 1 -- 172.21.15.63:0/2210874427 shutdown_connections 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2210874427 >> [v2:172.21.15.71:6835/767391345,v1:172.21.15.71:6837/767391345] conn(0x5607b8b22e40 0x5607b8f226f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2210874427 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b64270 0x5607b8f64670 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2210874427 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b43590 0x5607b8f4a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e0bfff640 0 client.4710 ms_handle_reset on v2:172.21.15.71:6835/767391345 2024-09-21T07:00:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2210874427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b3b3b0 0x5607b8f65120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e3a850740 1 -- 172.21.15.63:0/2210874427 >> 172.21.15.63:0/2210874427 conn(0x5607b8b583c0 msgr2=0x5607b8f24030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e3a850740 1 -- 172.21.15.63:0/2210874427 shutdown_connections 2024-09-21T07:00:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e3a850740 1 -- 172.21.15.63:0/2210874427 wait complete. 2024-09-21T07:00:36.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.114+0000 7f2e3a850740 20 client.4710 trim_cache size 0 max 16384 2024-09-21T07:00:36.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.133+0000 7f2e3a850740 1 Processor -- start 2024-09-21T07:00:36.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.133+0000 7f2e3a850740 1 -- start start 2024-09-21T07:00:36.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.134+0000 7f2e3a850740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b22e40 0x5607b8f79060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.134+0000 7f2e3a850740 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f25b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.134+0000 7f2e3a850740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 0x5607b8f26080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.134+0000 7f2e3a850740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c06e600 con 0x5607b8b43590 2024-09-21T07:00:36.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.134+0000 7f2e3a850740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c09fcd0 con 0x5607b8b22e40 2024-09-21T07:00:36.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.134+0000 7f2e3a850740 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2e2c06df90 con 0x5607b8b3b3b0 2024-09-21T07:00:36.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.134+0000 7f2e31da7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 0x5607b8f26080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.134+0000 7f2e31da7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 0x5607b8f26080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37170/0 (socket says 172.21.15.63:37170) 2024-09-21T07:00:36.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.134+0000 7f2e31da7640 1 -- 172.21.15.63:0/3128577048 learned_addr learned my addr 172.21.15.63:0/3128577048 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:36.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.135+0000 7f2e30da5640 1 --2- 172.21.15.63:0/3128577048 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f25b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.135+0000 7f2e315a6640 1 --2- 172.21.15.63:0/3128577048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b22e40 0x5607b8f79060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.135+0000 7f2e31da7640 1 -- 172.21.15.63:0/3128577048 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 msgr2=0x5607b8f25b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:00:36.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.135+0000 7f2e31da7640 1 --2- 172.21.15.63:0/3128577048 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f25b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.135+0000 7f2e31da7640 1 -- 172.21.15.63:0/3128577048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b22e40 msgr2=0x5607b8f79060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:00:36.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.135+0000 7f2e31da7640 1 --2- 172.21.15.63:0/3128577048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b22e40 0x5607b8f79060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.135+0000 7f2e31da7640 1 -- 172.21.15.63:0/3128577048 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607b8f06b80 con 0x5607b8b43590 2024-09-21T07:00:36.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.135+0000 7f2e31da7640 1 --2- 172.21.15.63:0/3128577048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 0x5607b8f26080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2e2401a4a0 tx=0x7f2e24009980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e7703ee1576ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:36.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.135+0000 7f2e167fc640 1 -- 172.21.15.63:0/3128577048 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24039070 con 0x5607b8b43590 2024-09-21T07:00:36.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.135+0000 7f2e167fc640 1 -- 172.21.15.63:0/3128577048 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e24028070 con 0x5607b8b43590 2024-09-21T07:00:36.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.135+0000 7f2e167fc640 1 -- 172.21.15.63:0/3128577048 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2401f040 con 0x5607b8b43590 2024-09-21T07:00:36.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.136+0000 7f2e3a850740 1 -- 172.21.15.63:0/3128577048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 msgr2=0x5607b8f26080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.136+0000 7f2e3a850740 1 --2- 172.21.15.63:0/3128577048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 0x5607b8f26080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2e2401a4a0 tx=0x7f2e24009980 comp rx=0 tx=0).stop 2024-09-21T07:00:36.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.136+0000 7f2e3a850740 1 -- 172.21.15.63:0/3128577048 shutdown_connections 2024-09-21T07:00:36.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.136+0000 7f2e3a850740 1 --2- 172.21.15.63:0/3128577048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b43590 0x5607b8f26080 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.136+0000 7f2e3a850740 1 --2- 172.21.15.63:0/3128577048 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f25b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.136+0000 7f2e3a850740 1 --2- 172.21.15.63:0/3128577048 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b22e40 0x5607b8f79060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.136+0000 7f2e3a850740 1 -- 172.21.15.63:0/3128577048 >> 172.21.15.63:0/3128577048 conn(0x5607b8b583c0 msgr2=0x5607b8f50530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:36.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.136+0000 7f2e3a850740 1 -- 172.21.15.63:0/3128577048 shutdown_connections 2024-09-21T07:00:36.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.136+0000 7f2e3a850740 1 -- 172.21.15.63:0/3128577048 wait complete. 2024-09-21T07:00:36.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.137+0000 7f2e3a850740 1 -- start start 2024-09-21T07:00:36.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.137+0000 7f2e3a850740 1 Processor -- start 2024-09-21T07:00:36.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.138+0000 7f2e3a850740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b22e40 0x5607b8fd83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.138+0000 7f2e3a850740 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f35d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.138+0000 7f2e3a850740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b43590 0x5607b8f658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.138+0000 7f2e3a850740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5607b8f67730 con 0x5607b8b22e40 2024-09-21T07:00:36.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.138+0000 7f2e3a850740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5607b8f65760 con 0x5607b8b43590 2024-09-21T07:00:36.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.138+0000 7f2e3a850740 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x5607b8f64f00 con 0x5607b8b3b3b0 2024-09-21T07:00:36.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.138+0000 7f2e3a850740 10 client.0 _ll_register_callbacks cb 0x7f2e24009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:00:36.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.138+0000 7f2e315a6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b22e40 0x5607b8fd83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.138+0000 7f2e315a6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b22e40 0x5607b8fd83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37186/0 (socket says 172.21.15.63:37186) 2024-09-21T07:00:36.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.138+0000 7f2e315a6640 1 -- 172.21.15.63:0/2312386086 learned_addr learned my addr 172.21.15.63:0/2312386086 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:36.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.138+0000 7f2e31da7640 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b43590 0x5607b8f658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.138+0000 7f2e30da5640 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f35d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e315a6640 1 -- 172.21.15.63:0/2312386086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 msgr2=0x5607b8f35d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e315a6640 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f35d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e315a6640 1 -- 172.21.15.63:0/2312386086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b43590 msgr2=0x5607b8f658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e315a6640 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b43590 0x5607b8f658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e315a6640 1 -- 172.21.15.63:0/2312386086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607b8f53430 con 0x5607b8b22e40 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e30da5640 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f35d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e315a6640 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b22e40 0x5607b8fd83e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009c70 tx=0x7f2e280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ab9cbfc2d1f2aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2312386086 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28058020 con 0x5607b8b22e40 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2312386086 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2e2803ea10 con 0x5607b8b22e40 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e3a850740 1 -- 172.21.15.63:0/2312386086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e24028070 con 0x5607b8b22e40 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2312386086 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f2e28062050 con 0x5607b8b22e40 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e3a850740 10 client.4716 fetch_fsmap learned FSMap version 8 2024-09-21T07:00:36.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e3a850740 1 -- 172.21.15.63:0/2312386086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5607b8f36290 con 0x5607b8b22e40 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2312386086 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e24028070 con 0x5607b8b22e40 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2312386086 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f2e28065020 con 0x5607b8b22e40 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e3a850740 10 client.4716 fetch_fsmap finished waiting for FSMap version 8 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e3a850740 10 client.4716 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e3a850740 20 client.4716 populate_metadata read hostname 'smithi063' 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.71:6835/767391345,v1:172.21.15.71:6837/767391345] conn(0x5607b8af8280 0x5607b8f62ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e3a850740 4 client.4716 mds_command: new command op to 4410 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.139+0000 7f2e3a850740 1 -- 172.21.15.63:0/2312386086 --> [v2:172.21.15.71:6835/767391345,v1:172.21.15.71:6837/767391345] -- command(tid 0: {"prefix": "status"}) -- 0x5607b8f072b0 con 0x5607b8af8280 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e30da5640 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.71:6835/767391345,v1:172.21.15.71:6837/767391345] conn(0x5607b8af8280 0x5607b8f62ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e0bfff640 10 client.4716 ms_handle_connect on v2:172.21.15.71:6835/767391345 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e30da5640 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.71:6835/767391345,v1:172.21.15.71:6837/767391345] conn(0x5607b8af8280 0x5607b8f62ad0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14041ca063d6be14 server_cookie=989fa3f3cf0da8a1 in_seq=0 out_seq=0 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e0bfff640 1 -- 172.21.15.63:0/2312386086 <== mds.0 v2:172.21.15.71:6835/767391345 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5607b8f072b0 con 0x5607b8af8280 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e0bfff640 10 client.4716 handle_command_reply: tid=0 2024-09-21T07:00:36.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e3a850740 1 client.4716 shutdown 2024-09-21T07:00:36.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e3a850740 1 -- 172.21.15.63:0/2312386086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b22e40 msgr2=0x5607b8fd83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b22e40 0x5607b8fd83e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009c70 tx=0x7f2e280046c0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e3a850740 1 -- 172.21.15.63:0/2312386086 shutdown_connections 2024-09-21T07:00:36.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.71:6835/767391345,v1:172.21.15.71:6837/767391345] conn(0x5607b8af8280 0x5607b8f62ad0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5607b8b43590 0x5607b8f658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e0bfff640 0 client.4716 ms_handle_reset on v2:172.21.15.71:6835/767391345 2024-09-21T07:00:36.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x5607b8b3b3b0 0x5607b8f35d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.140+0000 7f2e3a850740 1 --2- 172.21.15.63:0/2312386086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607b8b22e40 0x5607b8fd83e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3a850740 1 -- 172.21.15.63:0/2312386086 >> 172.21.15.63:0/2312386086 conn(0x5607b8b583c0 msgr2=0x5607b8f79060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:36.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3a850740 1 -- 172.21.15.63:0/2312386086 shutdown_connections 2024-09-21T07:00:36.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3a850740 1 -- 172.21.15.63:0/2312386086 wait complete. 2024-09-21T07:00:36.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3a850740 20 client.4716 trim_cache size 0 max 16384 2024-09-21T07:00:36.148 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T07:00:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "2c317557-147d-48e9-8f3c-bb88131d3e37", 2024-09-21T07:00:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-09-21T07:00:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4410, 2024-09-21T07:00:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-21T07:00:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-21T07:00:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-21T07:00:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 14.606323764000001, 2024-09-21T07:00:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 8, 2024-09-21T07:00:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 22, 2024-09-21T07:00:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 22, 2024-09-21T07:00:36.148 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 20.624688585000001 2024-09-21T07:00:36.148 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T07:00:36.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3380a640 1 -- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2e10078bc0 msgr2=0x7f2e1007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3380a640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2e10078bc0 0x7f2e1007b0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2e28035000 tx=0x7f2e2802d040 comp rx=0 tx=0).stop 2024-09-21T07:00:36.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3380a640 1 -- 172.21.15.63:0/1990666453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e2c1483e0 msgr2=0x7f2e2c159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3380a640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e2c1483e0 0x7f2e2c159730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c006e80 tx=0x7f2e1c0049d0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3380a640 1 -- 172.21.15.63:0/1990666453 shutdown_connections 2024-09-21T07:00:36.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3380a640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2e10078bc0 0x7f2e1007b0d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3380a640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e2c159c70 0x7f2e2c148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3380a640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e2c1483e0 0x7f2e2c159730 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3380a640 1 --2- 172.21.15.63:0/1990666453 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2e18003ae0 0x7f2e2c1f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3380a640 1 -- 172.21.15.63:0/1990666453 >> 172.21.15.63:0/1990666453 conn(0x7f2e2c0b3fb0 msgr2=0x7f2e2c071220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:36.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3380a640 1 -- 172.21.15.63:0/1990666453 shutdown_connections 2024-09-21T07:00:36.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.141+0000 7f2e3380a640 1 -- 172.21.15.63:0/1990666453 wait complete. 2024-09-21T07:00:36.154 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T07:00:36.178 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T07:00:36.178 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-21T07:00:36.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:36.179 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-21T07:00:36.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:36.195 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-21T07:00:36.262 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2024-09-21T07:00:36.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:00:36.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:36.264 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-21T07:00:36.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:36.321 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-21T07:00:36.388 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2024-09-21T07:00:36.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:00:36.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:36.390 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-09-21T07:00:36.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:36.410 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2024-09-21T07:00:36.483 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2024-09-21T07:00:36.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:00:36.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:36.486 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-09-21T07:00:36.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:36.550 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2024-09-21T07:00:36.623 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2024-09-21T07:00:36.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:00:36.625 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-21T07:00:36.625 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:00:36.625 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:00:36.625 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:00:36.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.742+0000 7fd19a7c6640 1 -- 172.21.15.63:0/2841984492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd17c003b10 msgr2=0x7fd17c003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.742+0000 7fd19a7c6640 1 --2- 172.21.15.63:0/2841984492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd17c003b10 0x7fd17c003f80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd18400c310 tx=0x7fd17c005830 comp rx=0 tx=0).stop 2024-09-21T07:00:36.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.742+0000 7fd198d63640 1 -- 172.21.15.63:0/2841984492 reap_dead start 2024-09-21T07:00:36.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.742+0000 7fd19a7c6640 1 -- 172.21.15.63:0/2841984492 shutdown_connections 2024-09-21T07:00:36.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.742+0000 7fd19a7c6640 1 -- 172.21.15.63:0/2841984492 >> 172.21.15.63:0/2841984492 conn(0x7fd1940ceed0 msgr2=0x7fd1940cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:36.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.742+0000 7fd19a7c6640 1 -- 172.21.15.63:0/2841984492 shutdown_connections 2024-09-21T07:00:36.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.742+0000 7fd19a7c6640 1 -- 172.21.15.63:0/2841984492 wait complete. 2024-09-21T07:00:36.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.744+0000 7fd19a7c6640 1 Processor -- start 2024-09-21T07:00:36.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.744+0000 7fd19a7c6640 1 -- start start 2024-09-21T07:00:36.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.745+0000 7fd19a7c6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd17c003b10 0x7fd1940cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.745+0000 7fd19a7c6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd1940c66b0 0x7fd19415c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.745+0000 7fd19a7c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd19415c7f0 0x7fd1941f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.745+0000 7fd19a7c6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd1940d0760 con 0x7fd17c003b10 2024-09-21T07:00:36.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.745+0000 7fd19a7c6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd1940d1400 con 0x7fd19415c7f0 2024-09-21T07:00:36.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.745+0000 7fd19a7c6640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd1940b8280 con 0x7fd1940c66b0 2024-09-21T07:00:36.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.745+0000 7fd193fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd17c003b10 0x7fd1940cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.745+0000 7fd193fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd17c003b10 0x7fd1940cda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37206/0 (socket says 172.21.15.63:37206) 2024-09-21T07:00:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.745+0000 7fd193fff640 1 -- 172.21.15.63:0/514831694 learned_addr learned my addr 172.21.15.63:0/514831694 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.745+0000 7fd1937fe640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd1940c66b0 0x7fd19415c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.745+0000 7fd198d63640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd19415c7f0 0x7fd1941f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.746+0000 7fd193fff640 1 -- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd1940c66b0 msgr2=0x7fd19415c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.746+0000 7fd193fff640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd1940c66b0 0x7fd19415c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.746+0000 7fd193fff640 1 -- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd19415c7f0 msgr2=0x7fd1941f6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.746+0000 7fd193fff640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd19415c7f0 0x7fd1941f6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.746+0000 7fd193fff640 1 -- 172.21.15.63:0/514831694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19415cc00 con 0x7fd17c003b10 2024-09-21T07:00:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.746+0000 7fd193fff640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd17c003b10 0x7fd1940cda20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd184030040 tx=0x7fd1840060d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.746+0000 7fd190ff9640 1 -- 172.21.15.63:0/514831694 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184031050 con 0x7fd17c003b10 2024-09-21T07:00:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.746+0000 7fd190ff9640 1 -- 172.21.15.63:0/514831694 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd184003610 con 0x7fd17c003b10 2024-09-21T07:00:36.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.746+0000 7fd19a7c6640 1 -- 172.21.15.63:0/514831694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1940c8520 con 0x7fd17c003b10 2024-09-21T07:00:36.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.746+0000 7fd190ff9640 1 -- 172.21.15.63:0/514831694 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184003a40 con 0x7fd17c003b10 2024-09-21T07:00:36.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.746+0000 7fd19a7c6640 1 -- 172.21.15.63:0/514831694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1940c8ae0 con 0x7fd17c003b10 2024-09-21T07:00:36.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.747+0000 7fd19a7c6640 1 -- 172.21.15.63:0/514831694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1940b7750 con 0x7fd17c003b10 2024-09-21T07:00:36.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.748+0000 7fd190ff9640 1 -- 172.21.15.63:0/514831694 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd18402d460 con 0x7fd17c003b10 2024-09-21T07:00:36.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.748+0000 7fd190ff9640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd180078b90 0x7fd18007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:36.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.748+0000 7fd190ff9640 1 -- 172.21.15.63:0/514831694 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd1840bb040 con 0x7fd17c003b10 2024-09-21T07:00:36.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.748+0000 7fd1937fe640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd180078b90 0x7fd18007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:36.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.749+0000 7fd1937fe640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd180078b90 0x7fd18007b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd1940b5c60 tx=0x7fd188006b70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:36.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.753+0000 7fd190ff9640 1 -- 172.21.15.63:0/514831694 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd184046060 con 0x7fd17c003b10 2024-09-21T07:00:36.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.975+0000 7fd19a7c6640 1 -- 172.21.15.63:0/514831694 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd1940c5ce0 con 0x7fd17c003b10 2024-09-21T07:00:36.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.975+0000 7fd190ff9640 1 -- 172.21.15.63:0/514831694 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fd19415cc00 con 0x7fd17c003b10 2024-09-21T07:00:36.977 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:00:36.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.977+0000 7fd19a7c6640 1 -- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd180078b90 msgr2=0x7fd18007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.977+0000 7fd19a7c6640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd180078b90 0x7fd18007b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd1940b5c60 tx=0x7fd188006b70 comp rx=0 tx=0).stop 2024-09-21T07:00:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.977+0000 7fd19a7c6640 1 -- 172.21.15.63:0/514831694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd17c003b10 msgr2=0x7fd1940cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.977+0000 7fd19a7c6640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd17c003b10 0x7fd1940cda20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd184030040 tx=0x7fd1840060d0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.977+0000 7fd19a7c6640 1 -- 172.21.15.63:0/514831694 shutdown_connections 2024-09-21T07:00:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.977+0000 7fd19a7c6640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd180078b90 0x7fd18007b0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.977+0000 7fd19a7c6640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd19415c7f0 0x7fd1941f6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.977+0000 7fd19a7c6640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd1940c66b0 0x7fd19415c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.977+0000 7fd19a7c6640 1 --2- 172.21.15.63:0/514831694 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd17c003b10 0x7fd1940cda20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.977+0000 7fd19a7c6640 1 -- 172.21.15.63:0/514831694 >> 172.21.15.63:0/514831694 conn(0x7fd1940ceed0 msgr2=0x7fd1940b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.978+0000 7fd19a7c6640 1 -- 172.21.15.63:0/514831694 shutdown_connections 2024-09-21T07:00:36.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:36.978+0000 7fd19a7c6640 1 -- 172.21.15.63:0/514831694 wait complete. 2024-09-21T07:00:36.990 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:00:36.990 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:00:36.991 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-09-21T07:00:36.991 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:00:36.991 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:00:36.991 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:00:36.991 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:00:36.991 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:00:36.991 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:00:36.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:36.991 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-09-21T07:00:37.008 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:00:37.008 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:00:37.008 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:00:37.008 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:37.008 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-21T07:00:37.008 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:37.008 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:00:37.008 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:37.008 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-09-21T07:00:37.009 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:00:37.009 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:37.009 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-09-21T07:00:37.009 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:00:37.009 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:37.009 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:00:37.009 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:37.009 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T07:00:37.009 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42788sec preferred_lft 42788sec 2024-09-21T07:00:37.009 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link noprefixroute 2024-09-21T07:00:37.009 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:37.010 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:00:37.010 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:37.010 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T07:00:37.010 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:00:37.010 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2024-09-21T07:00:37.010 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2024-09-21T07:00:37.010 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:00:37.010 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T07:00:37.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:37.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:37.211 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:00:37.237 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-09-21T07:00:37.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:37.239 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-09-21T07:00:37.314 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-09-21T07:00:37.315 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:00:37.315 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:00:37.315 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:00:37.315 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:00:37.315 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:37.315 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T07:00:37.315 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:00:37.315 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:00:37.315 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:00:37.316 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T07:00:37.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:37.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:37.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:37.605 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-21T07:00:37.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:37.621 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-09-21T07:00:37.678 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:37.679 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T07:00:37.679 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:00:37.679 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T07:00:37.679 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T07:00:37.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:37.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:37.799 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T07:00:37.799 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:37.800 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T07:00:37.800 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T07:00:37.800 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:00:37.800 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T07:00:37.800 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T07:00:37.800 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T07:00:37.800 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T07:00:37.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:37.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:37.943 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:37.943 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T07:00:37.943 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-09-21T07:00:37.944 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:00:37.944 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T07:00:37.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:38.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:38.024 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:00:38.024 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:00:38.039 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:00:38.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:00:38.040 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:00:38.096 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:00:38.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:38.096 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:00:38.207 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:00:38.207 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:00:38.338 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:00:38.338 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:00:38.338 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-09-21T07:00:38.338 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with new device syntax: 0@2c317557-147d-48e9-8f3c-bb88131d3e37.cephfs=/ 2024-09-21T07:00:38.338 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.63:3300/172.21.15.71:3300/172.21.15.71:3301" will pass to kernel 2024-09-21T07:00:38.338 INFO:teuthology.orchestra.run.smithi063.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T07:00:38.339 INFO:teuthology.orchestra.run.smithi063.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:00:38.339 INFO:teuthology.orchestra.run.smithi063.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:00:38.339 INFO:teuthology.orchestra.run.smithi063.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:00:38.339 INFO:teuthology.orchestra.run.smithi063.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:00:38.340 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:00:38.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:38.341 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:00:38.366 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:00:38.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:00:38.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:38.470 INFO:teuthology.orchestra.run.smithi063.stdout:client4663 2024-09-21T07:00:38.470 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:00:38.470 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:38.486 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:00:38.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:00:38.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:38.590 INFO:teuthology.orchestra.run.smithi063.stdout:client4663 2024-09-21T07:00:38.590 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:00:38.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:00:38.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:38.654 INFO:teuthology.orchestra.run.smithi063.stdout:client4663 2024-09-21T07:00:38.654 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2c317557-147d-48e9-8f3c-bb88131d3e37.client4663/status') 2024-09-21T07:00:38.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:38.719 INFO:teuthology.orchestra.run.smithi063.stdout:instance: client.4663 (3)172.21.15.63:0/248115102 2024-09-21T07:00:38.719 INFO:teuthology.orchestra.run.smithi063.stdout:blocklisted: false 2024-09-21T07:00:38.719 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records in 2024-09-21T07:00:38.719 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records out 2024-09-21T07:00:38.719 INFO:teuthology.orchestra.run.smithi063.stderr:69 bytes copied, 2.4797e-05 s, 2.8 MB/s 2024-09-21T07:00:38.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:38.727 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-21T07:00:38.727 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:00:38.727 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T07:00:38.727 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:00:38.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.842+0000 7fd5a9a30640 1 -- 172.21.15.63:0/1552059408 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5a40cd300 msgr2=0x7fd5a40ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:38.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.842+0000 7fd5a9a30640 1 --2- 172.21.15.63:0/1552059408 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5a40cd300 0x7fd5a40ce470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd59c005fd0 tx=0x7fd59c02aa10 comp rx=0 tx=0).stop 2024-09-21T07:00:38.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.842+0000 7fd5a9a30640 1 -- 172.21.15.63:0/1552059408 shutdown_connections 2024-09-21T07:00:38.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.842+0000 7fd5a9a30640 1 --2- 172.21.15.63:0/1552059408 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5a40cd300 0x7fd5a40ce470 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:38.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.842+0000 7fd5a9a30640 1 --2- 172.21.15.63:0/1552059408 >> v2:172.21.15.71:3300/0 conn(0x7fd5a40b4d00 0x7fd5a40b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:38.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.842+0000 7fd5a9a30640 1 -- 172.21.15.63:0/1552059408 >> 172.21.15.63:0/1552059408 conn(0x7fd5a406d3e0 msgr2=0x7fd5a40b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:38.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.843+0000 7fd5a9a30640 1 -- 172.21.15.63:0/1552059408 shutdown_connections 2024-09-21T07:00:38.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.843+0000 7fd5a9a30640 1 -- 172.21.15.63:0/1552059408 wait complete. 2024-09-21T07:00:38.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.844+0000 7fd5a9a30640 1 Processor -- start 2024-09-21T07:00:38.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.845+0000 7fd5a9a30640 1 -- start start 2024-09-21T07:00:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a9a30640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5a406f020 0x7fd5a4157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a9a30640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5a40b4d00 0x7fd5a41e7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a9a30640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a41e7870 0x7fd5a41e1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a9a30640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a40ceeb0 con 0x7fd5a41e7870 2024-09-21T07:00:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a9a30640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a40ced30 con 0x7fd5a40b4d00 2024-09-21T07:00:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a9a30640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a40cf030 con 0x7fd5a406f020 2024-09-21T07:00:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a41e7870 0x7fd5a41e1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a41e7870 0x7fd5a41e1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40872/0 (socket says 172.21.15.63:40872) 2024-09-21T07:00:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a37fe640 1 -- 172.21.15.63:0/3203228089 learned_addr learned my addr 172.21.15.63:0/3203228089 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a2ffd640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5a406f020 0x7fd5a4157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a27fc640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5a40b4d00 0x7fd5a41e7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a37fe640 1 -- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5a406f020 msgr2=0x7fd5a4157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a37fe640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5a406f020 0x7fd5a4157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a37fe640 1 -- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5a40b4d00 msgr2=0x7fd5a41e7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a37fe640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5a40b4d00 0x7fd5a41e7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a37fe640 1 -- 172.21.15.63:0/3203228089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a41e6290 con 0x7fd5a41e7870 2024-09-21T07:00:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.846+0000 7fd5a2ffd640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5a406f020 0x7fd5a4157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.847+0000 7fd5a37fe640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a41e7870 0x7fd5a41e1e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd59c02afd0 tx=0x7fd59c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.847+0000 7fd58bfff640 1 -- 172.21.15.63:0/3203228089 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c033050 con 0x7fd5a41e7870 2024-09-21T07:00:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.847+0000 7fd5a9a30640 1 -- 172.21.15.63:0/3203228089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a41e6570 con 0x7fd5a41e7870 2024-09-21T07:00:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.847+0000 7fd58bfff640 1 -- 172.21.15.63:0/3203228089 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd59c004250 con 0x7fd5a41e7870 2024-09-21T07:00:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.847+0000 7fd58bfff640 1 -- 172.21.15.63:0/3203228089 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c004680 con 0x7fd5a41e7870 2024-09-21T07:00:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.847+0000 7fd5a9a30640 1 -- 172.21.15.63:0/3203228089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a41e6b30 con 0x7fd5a41e7870 2024-09-21T07:00:38.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.848+0000 7fd5a9a30640 1 -- 172.21.15.63:0/3203228089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a40cf550 con 0x7fd5a41e7870 2024-09-21T07:00:38.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.849+0000 7fd58bfff640 1 -- 172.21.15.63:0/3203228089 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd59c036070 con 0x7fd5a41e7870 2024-09-21T07:00:38.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.849+0000 7fd58bfff640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd590078b90 0x7fd59007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:38.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.849+0000 7fd58bfff640 1 -- 172.21.15.63:0/3203228089 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd59c0bbe50 con 0x7fd5a41e7870 2024-09-21T07:00:38.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.849+0000 7fd5a2ffd640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd590078b90 0x7fd59007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:38.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.850+0000 7fd5a2ffd640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd590078b90 0x7fd59007b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd594009b80 tx=0x7fd594005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:38.854+0000 7fd58bfff640 1 -- 172.21.15.63:0/3203228089 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd59c084210 con 0x7fd5a41e7870 2024-09-21T07:00:39.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.077+0000 7fd5a9a30640 1 -- 172.21.15.63:0/3203228089 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd5a406a7b0 con 0x7fd5a41e7870 2024-09-21T07:00:39.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.077+0000 7fd58bfff640 1 -- 172.21.15.63:0/3203228089 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fd59c004820 con 0x7fd5a41e7870 2024-09-21T07:00:39.079 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:00:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.079+0000 7fd5a9a30640 1 -- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd590078b90 msgr2=0x7fd59007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.079+0000 7fd5a9a30640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd590078b90 0x7fd59007b0a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd594009b80 tx=0x7fd594005f90 comp rx=0 tx=0).stop 2024-09-21T07:00:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.079+0000 7fd5a9a30640 1 -- 172.21.15.63:0/3203228089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a41e7870 msgr2=0x7fd5a41e1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.079+0000 7fd5a9a30640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a41e7870 0x7fd5a41e1e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd59c02afd0 tx=0x7fd59c003f10 comp rx=0 tx=0).stop 2024-09-21T07:00:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.079+0000 7fd5a9a30640 1 -- 172.21.15.63:0/3203228089 shutdown_connections 2024-09-21T07:00:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.079+0000 7fd5a9a30640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd590078b90 0x7fd59007b0a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.079+0000 7fd5a9a30640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5a41e7870 0x7fd5a41e1e10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.079+0000 7fd5a9a30640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5a40b4d00 0x7fd5a41e7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.079+0000 7fd5a9a30640 1 --2- 172.21.15.63:0/3203228089 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd5a406f020 0x7fd5a4157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.080+0000 7fd5a9a30640 1 -- 172.21.15.63:0/3203228089 >> 172.21.15.63:0/3203228089 conn(0x7fd5a406d3e0 msgr2=0x7fd5a40ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.080+0000 7fd5a9a30640 1 -- 172.21.15.63:0/3203228089 shutdown_connections 2024-09-21T07:00:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39.080+0000 7fd5a9a30640 1 -- 172.21.15.63:0/3203228089 wait complete. 2024-09-21T07:00:39.092 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:00:39.092 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:00:39.092 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-09-21T07:00:39.092 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-21T07:00:39.092 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-21T07:00:39.092 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:00:39.093 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:00:39.093 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:00:39.093 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-21T07:00:39.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:39.093 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-09-21T07:00:39.109 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:00:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:00:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:00:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-21T07:00:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.109 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:00:39.109 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42786sec preferred_lft 42786sec 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link noprefixroute 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:00:39.110 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 2e:ea:81:6e:70:d5 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:00:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::f829:63ff:feb6:60/64 scope link 2024-09-21T07:00:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.111 INFO:teuthology.orchestra.run.smithi063.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:00:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 2e:ea:81:6e:70:d5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:00:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::2cea:81ff:fe6e:70d5/64 scope link tentative 2024-09-21T07:00:39.111 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:39.111 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:00:39.174 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-09-21T07:00:39.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:39.176 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-09-21T07:00:39.232 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-09-21T07:00:39.232 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:00:39.232 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:00:39.232 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:00:39.232 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:00:39.233 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:39.233 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T07:00:39.233 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:00:39.233 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:00:39.233 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:00:39.233 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T07:00:39.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:39.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:39.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:39.362 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-21T07:00:39.377 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:00:39.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:39.378 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-09-21T07:00:39.433 INFO:teuthology.orchestra.run.smithi063.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-21T07:00:39.433 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:39.434 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T07:00:39.434 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:00:39.434 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-21T07:00:39.434 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T07:00:39.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:39.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:39.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:39.552 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T07:00:39.577 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:00:39.577 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:00:39.577 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:00:39.577 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.578 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-21T07:00:39.578 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.578 INFO:teuthology.orchestra.run.smithi063.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:00:39.578 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether ca:b8:12:67:c9:d7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T07:00:39.578 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T07:00:39.578 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.578 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::c8b8:12ff:fe67:c9d7/64 scope link tentative 2024-09-21T07:00:39.578 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:39.579 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-21T07:00:39.645 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:00:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:00:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:00:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-21T07:00:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.645 INFO:teuthology.orchestra.run.smithi063.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:00:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether ca:b8:12:67:c9:d7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T07:00:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T07:00:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.645 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::c8b8:12ff:fe67:c9d7/64 scope link 2024-09-21T07:00:39.646 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:39.647 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-21T07:00:39.647 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:39.647 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T07:00:39.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-21T07:00:39.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T07:00:39.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-21T07:00:39.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-21T07:00:39.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-21T07:00:39.647 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T07:00:39.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:39.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:39.801 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:39.801 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T07:00:39.801 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.1 up 2024-09-21T07:00:39.801 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T07:00:39.802 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T07:00:39.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:39.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:39.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:00:39.881 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-21T07:00:39.898 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-21T07:00:39.898 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:00:39.898 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-21T07:00:39.951 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-21T07:00:39.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:39.951 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:00:40.047 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:00:40.047 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:00:40.059 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:00:40.059 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:00:40.059 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-09-21T07:00:40.059 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with new device syntax: 2@2c317557-147d-48e9-8f3c-bb88131d3e37.cephfs=/ 2024-09-21T07:00:40.059 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.63:3300/172.21.15.71:3300/172.21.15.71:3301" will pass to kernel 2024-09-21T07:00:40.059 INFO:teuthology.orchestra.run.smithi063.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-21T07:00:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:00:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:00:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:00:40.060 INFO:teuthology.orchestra.run.smithi063.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:00:40.062 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:00:40.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:40.062 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-21T07:00:40.087 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:00:40.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:00:40.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:40.185 INFO:teuthology.orchestra.run.smithi063.stdout:client4675 2024-09-21T07:00:40.186 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:00:40.186 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:40.202 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:00:40.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:00:40.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:40.299 INFO:teuthology.orchestra.run.smithi063.stdout:client4675 2024-09-21T07:00:40.299 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:00:40.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:00:40.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:40.357 INFO:teuthology.orchestra.run.smithi063.stdout:client4675 2024-09-21T07:00:40.357 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2c317557-147d-48e9-8f3c-bb88131d3e37.client4675/status') 2024-09-21T07:00:40.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:40.416 INFO:teuthology.orchestra.run.smithi063.stdout:instance: client.4675 (3)172.21.15.63:0/821500092 2024-09-21T07:00:40.417 INFO:teuthology.orchestra.run.smithi063.stdout:blocklisted: false 2024-09-21T07:00:40.417 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records in 2024-09-21T07:00:40.417 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records out 2024-09-21T07:00:40.417 INFO:teuthology.orchestra.run.smithi063.stderr:69 bytes copied, 2.5427e-05 s, 2.7 MB/s 2024-09-21T07:00:40.418 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:40.424 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-21T07:00:40.424 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:00:40.424 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T07:00:40.424 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:00:40.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.538+0000 7f0dd98be640 1 -- 172.21.15.63:0/2080980977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dd409b150 msgr2=0x7f0dd40ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:40.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.538+0000 7f0dd98be640 1 --2- 172.21.15.63:0/2080980977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dd409b150 0x7f0dd40ccd20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc005fd0 tx=0x7f0dbc02a5d0 comp rx=0 tx=0).stop 2024-09-21T07:00:40.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.538+0000 7f0dd98be640 1 -- 172.21.15.63:0/2080980977 shutdown_connections 2024-09-21T07:00:40.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.538+0000 7f0dd98be640 1 --2- 172.21.15.63:0/2080980977 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dd40b3b60 0x7f0dd40cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:40.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.538+0000 7f0dd98be640 1 --2- 172.21.15.63:0/2080980977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dd409b150 0x7f0dd40ccd20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:40.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.538+0000 7f0dd98be640 1 -- 172.21.15.63:0/2080980977 >> 172.21.15.63:0/2080980977 conn(0x7f0dd40b3fb0 msgr2=0x7f0dd40b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:40.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.538+0000 7f0dd98be640 1 -- 172.21.15.63:0/2080980977 shutdown_connections 2024-09-21T07:00:40.541 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.538+0000 7f0dd98be640 1 -- 172.21.15.63:0/2080980977 wait complete. 2024-09-21T07:00:40.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.540+0000 7f0dd98be640 1 Processor -- start 2024-09-21T07:00:40.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.540+0000 7f0dd98be640 1 -- start start 2024-09-21T07:00:40.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.541+0000 7f0dd98be640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd40b3750 0x7f0dd415cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:40.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.541+0000 7f0dd98be640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dd40b3b60 0x7f0dd409ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd98be640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dd415e510 0x7f0dd415e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd98be640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd40cdfc0 con 0x7f0dd40b3750 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd98be640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd40cde40 con 0x7f0dd40b3b60 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd98be640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd40ce140 con 0x7f0dd415e510 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd40b3750 0x7f0dd415cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd40b3750 0x7f0dd415cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40874/0 (socket says 172.21.15.63:40874) 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd2ffd640 1 -- 172.21.15.63:0/63019028 learned_addr learned my addr 172.21.15.63:0/63019028 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd37fe640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dd415e510 0x7f0dd415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd27fc640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dd40b3b60 0x7f0dd409ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd2ffd640 1 -- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dd415e510 msgr2=0x7f0dd415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd2ffd640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dd415e510 0x7f0dd415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd2ffd640 1 -- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dd40b3b60 msgr2=0x7f0dd409ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd2ffd640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dd40b3b60 0x7f0dd409ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:40.545 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd2ffd640 1 -- 172.21.15.63:0/63019028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd415ee60 con 0x7f0dd40b3750 2024-09-21T07:00:40.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd27fc640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dd40b3b60 0x7f0dd409ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:40.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd2ffd640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd40b3750 0x7f0dd415cc00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400c3f0 tx=0x7f0dc400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:40.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dcbfff640 1 -- 172.21.15.63:0/63019028 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4017070 con 0x7f0dd40b3750 2024-09-21T07:00:40.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd98be640 1 -- 172.21.15.63:0/63019028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd409d4f0 con 0x7f0dd40b3750 2024-09-21T07:00:40.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dcbfff640 1 -- 172.21.15.63:0/63019028 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dc40035f0 con 0x7f0dd40b3750 2024-09-21T07:00:40.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dcbfff640 1 -- 172.21.15.63:0/63019028 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4003a40 con 0x7f0dd40b3750 2024-09-21T07:00:40.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.542+0000 7f0dd98be640 1 -- 172.21.15.63:0/63019028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd40b18f0 con 0x7f0dd40b3750 2024-09-21T07:00:40.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.543+0000 7f0dd98be640 1 -- 172.21.15.63:0/63019028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd409da10 con 0x7f0dd40b3750 2024-09-21T07:00:40.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.544+0000 7f0dcbfff640 1 -- 172.21.15.63:0/63019028 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0dc401a070 con 0x7f0dd40b3750 2024-09-21T07:00:40.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.545+0000 7f0dcbfff640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0db4078b90 0x7f0db407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:40.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.545+0000 7f0dcbfff640 1 -- 172.21.15.63:0/63019028 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0dc409a050 con 0x7f0dd40b3750 2024-09-21T07:00:40.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.545+0000 7f0dd27fc640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0db4078b90 0x7f0db407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:40.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.546+0000 7f0dd27fc640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0db4078b90 0x7f0db407b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc033000 tx=0x7f0dbc004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:40.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.549+0000 7f0dcbfff640 1 -- 172.21.15.63:0/63019028 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0dd409da10 con 0x7f0dd40b3750 2024-09-21T07:00:40.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.773+0000 7f0dd98be640 1 -- 172.21.15.63:0/63019028 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0dd40ce5f0 con 0x7f0dd40b3750 2024-09-21T07:00:40.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.774+0000 7f0dcbfff640 1 -- 172.21.15.63:0/63019028 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f0dd415ee60 con 0x7f0dd40b3750 2024-09-21T07:00:40.776 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:00:40.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.776+0000 7f0dd98be640 1 -- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0db4078b90 msgr2=0x7f0db407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:40.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.776+0000 7f0dd98be640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0db4078b90 0x7f0db407b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc033000 tx=0x7f0dbc004730 comp rx=0 tx=0).stop 2024-09-21T07:00:40.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.776+0000 7f0dd98be640 1 -- 172.21.15.63:0/63019028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd40b3750 msgr2=0x7f0dd415cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:40.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.776+0000 7f0dd98be640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd40b3750 0x7f0dd415cc00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400c3f0 tx=0x7f0dc400c7f0 comp rx=0 tx=0).stop 2024-09-21T07:00:40.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.776+0000 7f0dd98be640 1 -- 172.21.15.63:0/63019028 shutdown_connections 2024-09-21T07:00:40.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.776+0000 7f0dd98be640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0db4078b90 0x7f0db407b0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:40.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.776+0000 7f0dd98be640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0dd415e510 0x7f0dd415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:40.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.776+0000 7f0dd98be640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dd40b3b60 0x7f0dd409ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:40.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.776+0000 7f0dd98be640 1 --2- 172.21.15.63:0/63019028 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0dd40b3750 0x7f0dd415cc00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:40.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.776+0000 7f0dd98be640 1 -- 172.21.15.63:0/63019028 >> 172.21.15.63:0/63019028 conn(0x7f0dd40b3fb0 msgr2=0x7f0dd415fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:40.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.776+0000 7f0dd98be640 1 -- 172.21.15.63:0/63019028 shutdown_connections 2024-09-21T07:00:40.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:40.776+0000 7f0dd98be640 1 -- 172.21.15.63:0/63019028 wait complete. 2024-09-21T07:00:40.788 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:00:40.788 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:00:40.788 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2024-09-21T07:00:40.789 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T07:00:40.789 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T07:00:40.789 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:00:40.789 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:00:40.789 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:00:40.789 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T07:00:40.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:40.789 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2024-09-21T07:00:40.808 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:00:40.808 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T07:00:40.810 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42771sec preferred_lft 42771sec 2024-09-21T07:00:40.810 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link noprefixroute 2024-09-21T07:00:40.810 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:40.810 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T07:00:40.810 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:40.810 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-21T07:00:40.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add name ceph-brx type bridge 2024-09-21T07:00:40.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr flush dev ceph-brx 2024-09-21T07:00:40.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set ceph-brx up 2024-09-21T07:00:40.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T07:00:40.810 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-21T07:00:40.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:41.087 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:41.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:41.094 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:00:41.119 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-09-21T07:00:41.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:41.121 DEBUG:teuthology.orchestra.run.smithi071:> route 2024-09-21T07:00:41.196 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2024-09-21T07:00:41.196 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:00:41.196 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:00:41.196 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:00:41.196 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:00:41.197 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:41.197 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-21T07:00:41.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:00:41.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:00:41.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:00:41.197 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-21T07:00:41.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:41.513 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:41.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:41.519 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-09-21T07:00:41.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:41.534 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2024-09-21T07:00:41.590 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:41.590 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-21T07:00:41.590 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T07:00:41.590 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T07:00:41.591 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-21T07:00:41.680 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:41.707 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:41.714 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T07:00:41.714 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:41.714 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-21T07:00:41.714 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T07:00:41.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T07:00:41.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T07:00:41.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T07:00:41.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T07:00:41.715 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-21T07:00:41.770 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:41.857 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:41.863 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:41.863 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-21T07:00:41.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.0 up 2024-09-21T07:00:41.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T07:00:41.864 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-21T07:00:41.912 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:41.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:41.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:00:41.946 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T07:00:41.961 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T07:00:41.961 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:00:41.961 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T07:00:42.017 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-21T07:00:42.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:42.018 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:00:42.127 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:00:42.127 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:00:42.252 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:00:42.252 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:00:42.252 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-09-21T07:00:42.252 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 1@2c317557-147d-48e9-8f3c-bb88131d3e37.cephfs=/ 2024-09-21T07:00:42.253 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.63:3300/172.21.15.71:3300/172.21.15.71:3301" will pass to kernel 2024-09-21T07:00:42.253 INFO:teuthology.orchestra.run.smithi071.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-21T07:00:42.253 INFO:teuthology.orchestra.run.smithi071.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:00:42.253 INFO:teuthology.orchestra.run.smithi071.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:00:42.253 INFO:teuthology.orchestra.run.smithi071.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:00:42.253 INFO:teuthology.orchestra.run.smithi071.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:00:42.254 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:00:42.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:42.255 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T07:00:42.280 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:00:42.369 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:00:42.371 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:42.376 INFO:teuthology.orchestra.run.smithi071.stdout:client4544 2024-09-21T07:00:42.377 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T07:00:42.377 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:42.393 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:00:42.481 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:00:42.482 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:42.488 INFO:teuthology.orchestra.run.smithi071.stdout:client4544 2024-09-21T07:00:42.488 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:00:42.536 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:00:42.538 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:42.546 INFO:teuthology.orchestra.run.smithi071.stdout:client4544 2024-09-21T07:00:42.547 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2c317557-147d-48e9-8f3c-bb88131d3e37.client4544/status') 2024-09-21T07:00:42.595 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:42.606 INFO:teuthology.orchestra.run.smithi071.stdout:instance: client.4544 (3)192.168.0.1:0/176690878 2024-09-21T07:00:42.606 INFO:teuthology.orchestra.run.smithi071.stdout:blocklisted: false 2024-09-21T07:00:42.606 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records in 2024-09-21T07:00:42.606 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records out 2024-09-21T07:00:42.606 INFO:teuthology.orchestra.run.smithi071.stderr:68 bytes copied, 2.2198e-05 s, 3.1 MB/s 2024-09-21T07:00:42.607 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:42.613 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-21T07:00:42.613 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T07:00:42.613 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T07:00:42.613 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:00:42.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.743+0000 7f778d430640 1 -- 172.21.15.63:0/3242464029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f778815ef00 msgr2=0x7f77880d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:42.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.743+0000 7f778d430640 1 --2- 172.21.15.63:0/3242464029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f778815ef00 0x7f77880d2c40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f777c005fd0 tx=0x7f777c02a5d0 comp rx=0 tx=0).stop 2024-09-21T07:00:42.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.743+0000 7f778d430640 1 -- 172.21.15.63:0/3242464029 shutdown_connections 2024-09-21T07:00:42.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.743+0000 7f778d430640 1 --2- 172.21.15.63:0/3242464029 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77880cf310 0x7f77880cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:42.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.743+0000 7f778d430640 1 --2- 172.21.15.63:0/3242464029 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f778815ef00 0x7f77880d2c40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:42.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.743+0000 7f778d430640 1 -- 172.21.15.63:0/3242464029 >> 172.21.15.63:0/3242464029 conn(0x7f778808bfd0 msgr2=0x7f77880d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:42.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.743+0000 7f778d430640 1 -- 172.21.15.63:0/3242464029 shutdown_connections 2024-09-21T07:00:42.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.743+0000 7f778d430640 1 -- 172.21.15.63:0/3242464029 wait complete. 2024-09-21T07:00:42.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.745+0000 7f778d430640 1 Processor -- start 2024-09-21T07:00:42.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.745+0000 7f778d430640 1 -- start start 2024-09-21T07:00:42.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f778d430640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77880b7530 0x7f77881f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:42.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f778d430640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77880cf310 0x7f778815bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:42.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f778d430640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f778815ef00 0x7f77880b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:42.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f778d430640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f77880cfff0 con 0x7f77880b7530 2024-09-21T07:00:42.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f778d430640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f77880cfe70 con 0x7f77880cf310 2024-09-21T07:00:42.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f778d430640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f77880d0170 con 0x7f778815ef00 2024-09-21T07:00:42.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f7786ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77880b7530 0x7f77881f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:42.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f7786ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77880b7530 0x7f77881f6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40904/0 (socket says 172.21.15.63:40904) 2024-09-21T07:00:42.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f7786ffd640 1 -- 172.21.15.63:0/1679970746 learned_addr learned my addr 172.21.15.63:0/1679970746 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f77877fe640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f778815ef00 0x7f77880b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f77867fc640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77880cf310 0x7f778815bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f7786ffd640 1 -- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f778815ef00 msgr2=0x7f77880b8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f7786ffd640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f778815ef00 0x7f77880b8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f7786ffd640 1 -- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77880cf310 msgr2=0x7f778815bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f7786ffd640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77880cf310 0x7f778815bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f7786ffd640 1 -- 172.21.15.63:0/1679970746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7788160770 con 0x7f77880b7530 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f77867fc640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77880cf310 0x7f778815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f7786ffd640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77880b7530 0x7f77881f6550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f777800c3c0 tx=0x7f777800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f776f7fe640 1 -- 172.21.15.63:0/1679970746 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778017070 con 0x7f77880b7530 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f776f7fe640 1 -- 172.21.15.63:0/1679970746 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77780035f0 con 0x7f77880b7530 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.747+0000 7f778d430640 1 -- 172.21.15.63:0/1679970746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f778815c010 con 0x7f77880b7530 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.748+0000 7f776f7fe640 1 -- 172.21.15.63:0/1679970746 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778003a40 con 0x7f77880b7530 2024-09-21T07:00:42.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.748+0000 7f778d430640 1 -- 172.21.15.63:0/1679970746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f778815f9e0 con 0x7f77880b7530 2024-09-21T07:00:42.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.748+0000 7f778d430640 1 -- 172.21.15.63:0/1679970746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77880d0700 con 0x7f77880b7530 2024-09-21T07:00:42.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.749+0000 7f776f7fe640 1 -- 172.21.15.63:0/1679970746 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f777801a070 con 0x7f77880b7530 2024-09-21T07:00:42.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.750+0000 7f776f7fe640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7774078b90 0x7f777407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:42.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.750+0000 7f776f7fe640 1 -- 172.21.15.63:0/1679970746 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f777809a100 con 0x7f77880b7530 2024-09-21T07:00:42.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.750+0000 7f77867fc640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7774078b90 0x7f777407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:42.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.751+0000 7f77867fc640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7774078b90 0x7f777407b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f777c033000 tx=0x7f777c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:42.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.755+0000 7f776f7fe640 1 -- 172.21.15.63:0/1679970746 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7778062540 con 0x7f77880b7530 2024-09-21T07:00:42.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.983+0000 7f778d430640 1 -- 172.21.15.63:0/1679970746 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f778806a130 con 0x7f77880b7530 2024-09-21T07:00:42.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.983+0000 7f776f7fe640 1 -- 172.21.15.63:0/1679970746 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f7778061e40 con 0x7f77880b7530 2024-09-21T07:00:42.985 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:00:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.986+0000 7f778d430640 1 -- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7774078b90 msgr2=0x7f777407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.986+0000 7f778d430640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7774078b90 0x7f777407b0a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f777c033000 tx=0x7f777c004730 comp rx=0 tx=0).stop 2024-09-21T07:00:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.986+0000 7f778d430640 1 -- 172.21.15.63:0/1679970746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77880b7530 msgr2=0x7f77881f6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.986+0000 7f778d430640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77880b7530 0x7f77881f6550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f777800c3c0 tx=0x7f777800c880 comp rx=0 tx=0).stop 2024-09-21T07:00:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.986+0000 7f778d430640 1 -- 172.21.15.63:0/1679970746 shutdown_connections 2024-09-21T07:00:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.986+0000 7f778d430640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7774078b90 0x7f777407b0a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.986+0000 7f778d430640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f778815ef00 0x7f77880b8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.986+0000 7f778d430640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77880cf310 0x7f778815bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.986+0000 7f778d430640 1 --2- 172.21.15.63:0/1679970746 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77880b7530 0x7f77881f6550 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.986+0000 7f778d430640 1 -- 172.21.15.63:0/1679970746 >> 172.21.15.63:0/1679970746 conn(0x7f778808bfd0 msgr2=0x7f778815e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.986+0000 7f778d430640 1 -- 172.21.15.63:0/1679970746 shutdown_connections 2024-09-21T07:00:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:42.986+0000 7f778d430640 1 -- 172.21.15.63:0/1679970746 wait complete. 2024-09-21T07:00:42.998 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T07:00:42.998 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:00:42.998 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi071.front.sepia.ceph.com 2024-09-21T07:00:42.999 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-21T07:00:42.999 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-21T07:00:42.999 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T07:00:42.999 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T07:00:42.999 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:00:42.999 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-21T07:00:42.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:42.999 DEBUG:teuthology.orchestra.run.smithi071:> ip addr 2024-09-21T07:00:43.015 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:00:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:00:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:00:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-09-21T07:00:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.015 INFO:teuthology.orchestra.run.smithi071.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:00:43.015 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4a brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f0 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:d8:aa:4b brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: altname enp7s0f1 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:64 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether 0c:c4:7a:8f:d7:65 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: inet 172.21.15.71/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft 42768sec preferred_lft 42768sec 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::ec4:7aff:fe8f:d765/64 scope link noprefixroute 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether de:9d:50:19:af:56 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:00:43.016 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:00:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::b4c5:d2ff:fee3:230b/64 scope link 2024-09-21T07:00:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.017 INFO:teuthology.orchestra.run.smithi071.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:00:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether de:9d:50:19:af:56 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T07:00:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::dc9d:50ff:fe19:af56/64 scope link tentative 2024-09-21T07:00:43.017 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:43.017 DEBUG:teuthology.orchestra.run.smithi071:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:00:43.078 INFO:teuthology.orchestra.run.smithi071.stdout:1 2024-09-21T07:00:43.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:43.080 DEBUG:teuthology.orchestra.run.smithi071:> route 2024-09-21T07:00:43.136 INFO:teuthology.orchestra.run.smithi071.stdout:Kernel IP routing table 2024-09-21T07:00:43.136 INFO:teuthology.orchestra.run.smithi071.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:00:43.136 INFO:teuthology.orchestra.run.smithi071.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:00:43.136 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:00:43.136 INFO:teuthology.orchestra.run.smithi071.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:00:43.136 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:43.136 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-21T07:00:43.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:00:43.137 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:00:43.137 DEBUG:teuthology.orchestra.run.smithi071:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:00:43.137 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-21T07:00:43.223 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:43.255 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:43.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:43.262 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-09-21T07:00:43.277 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T07:00:43.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:43.277 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list-id 2024-09-21T07:00:43.332 INFO:teuthology.orchestra.run.smithi071.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-21T07:00:43.333 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:43.333 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-21T07:00:43.333 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T07:00:43.333 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-21T07:00:43.333 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-21T07:00:43.421 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:43.443 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:43.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:43.449 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T07:00:43.474 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:00:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:00:43.474 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:00:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-09-21T07:00:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.475 INFO:teuthology.orchestra.run.smithi071.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:00:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether b6:40:00:ec:da:09 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T07:00:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T07:00:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::b440:ff:feec:da09/64 scope link 2024-09-21T07:00:43.475 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:43.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-21T07:00:43.540 INFO:teuthology.orchestra.run.smithi071.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:00:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:00:43.540 INFO:teuthology.orchestra.run.smithi071.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:00:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 ::1/128 scope host 2024-09-21T07:00:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.541 INFO:teuthology.orchestra.run.smithi071.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:00:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: link/ether b6:40:00:ec:da:09 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-21T07:00:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-21T07:00:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: inet6 fe80::b440:ff:feec:da09/64 scope link 2024-09-21T07:00:43.541 INFO:teuthology.orchestra.run.smithi071.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:00:43.542 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-21T07:00:43.542 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:43.542 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-21T07:00:43.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-21T07:00:43.542 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-21T07:00:43.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-21T07:00:43.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-21T07:00:43.543 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-21T07:00:43.543 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-21T07:00:43.630 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:43.687 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:43.694 DEBUG:teuthology.orchestra.run.smithi071:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:00:43.694 DEBUG:teuthology.orchestra.run.smithi071:> set -e 2024-09-21T07:00:43.694 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set brx.1 up 2024-09-21T07:00:43.694 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link set dev brx.1 master ceph-brx 2024-09-21T07:00:43.694 DEBUG:teuthology.orchestra.run.smithi071:> ') 2024-09-21T07:00:43.741 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:43.763 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:43.770 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:00:43.770 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-21T07:00:43.785 INFO:teuthology.orchestra.run.smithi071.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-21T07:00:43.785 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:00:43.785 DEBUG:teuthology.orchestra.run.smithi071:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-21T07:00:43.840 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-21T07:00:43.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:43.840 DEBUG:teuthology.orchestra.run.smithi071:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:00:43.934 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:00:43.934 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:00:43.945 INFO:teuthology.orchestra.run.smithi071.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:00:43.946 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:00:43.946 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-09-21T07:00:43.946 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: trying mount with new device syntax: 3@2c317557-147d-48e9-8f3c-bb88131d3e37.cephfs=/ 2024-09-21T07:00:43.946 INFO:teuthology.orchestra.run.smithi071.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.63:3300/172.21.15.71:3300/172.21.15.71:3301" will pass to kernel 2024-09-21T07:00:43.946 INFO:teuthology.orchestra.run.smithi071.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-21T07:00:43.946 INFO:teuthology.orchestra.run.smithi071.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:00:43.946 INFO:teuthology.orchestra.run.smithi071.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:00:43.947 INFO:teuthology.orchestra.run.smithi071.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:00:43.947 INFO:teuthology.orchestra.run.smithi071.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:00:43.948 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:00:43.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:43.949 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-21T07:00:43.973 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:00:44.061 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:00:44.063 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:44.069 INFO:teuthology.orchestra.run.smithi071.stdout:client4553 2024-09-21T07:00:44.069 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T07:00:44.069 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:44.085 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:00:44.172 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:00:44.174 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:44.181 INFO:teuthology.orchestra.run.smithi071.stdout:client4553 2024-09-21T07:00:44.182 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:00:44.229 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:00:44.231 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:44.237 INFO:teuthology.orchestra.run.smithi071.stdout:client4553 2024-09-21T07:00:44.237 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/2c317557-147d-48e9-8f3c-bb88131d3e37.client4553/status') 2024-09-21T07:00:44.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:00:44.294 INFO:teuthology.orchestra.run.smithi071.stdout:instance: client.4553 (3)192.168.0.2:0/1586548630 2024-09-21T07:00:44.294 INFO:teuthology.orchestra.run.smithi071.stdout:blocklisted: false 2024-09-21T07:00:44.294 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records in 2024-09-21T07:00:44.294 INFO:teuthology.orchestra.run.smithi071.stderr:0+1 records out 2024-09-21T07:00:44.295 INFO:teuthology.orchestra.run.smithi071.stderr:69 bytes copied, 2.1588e-05 s, 3.2 MB/s 2024-09-21T07:00:44.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-21T07:00:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:00:44.301 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-21T07:00:45.871 INFO:tasks.cephfs_test_runner:Starting test: test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) 2024-09-21T07:00:45.872 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:00:46.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.002+0000 7f77591c2640 1 -- 172.21.15.63:0/3000308599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f773c004d40 msgr2=0x7f773c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.002+0000 7f77591c2640 1 --2- 172.21.15.63:0/3000308599 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f773c004d40 0x7f773c005150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f774c002230 tx=0x7f773c005830 comp rx=0 tx=0).stop 2024-09-21T07:00:46.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.002+0000 7f775359e640 1 -- 172.21.15.63:0/3000308599 reap_dead start 2024-09-21T07:00:46.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.002+0000 7f77591c2640 1 -- 172.21.15.63:0/3000308599 shutdown_connections 2024-09-21T07:00:46.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.002+0000 7f77591c2640 1 -- 172.21.15.63:0/3000308599 >> 172.21.15.63:0/3000308599 conn(0x7f775408bfd0 msgr2=0x7f77540d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:46.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.002+0000 7f77591c2640 1 -- 172.21.15.63:0/3000308599 shutdown_connections 2024-09-21T07:00:46.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.002+0000 7f77591c2640 1 -- 172.21.15.63:0/3000308599 wait complete. 2024-09-21T07:00:46.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.004+0000 7f77591c2640 1 Processor -- start 2024-09-21T07:00:46.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.004+0000 7f77591c2640 1 -- start start 2024-09-21T07:00:46.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f77591c2640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77540caa50 0x7f77541f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f77591c2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7754153280 0x7f7754153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f77591c2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77540b53a0 0x7f77540b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f77591c2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f77540d0320 con 0x7f7754153280 2024-09-21T07:00:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f77591c2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f77540b34c0 con 0x7f77540b53a0 2024-09-21T07:00:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f77591c2640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f77540d04a0 con 0x7f77540caa50 2024-09-21T07:00:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f775259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7754153280 0x7f7754153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f775259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7754153280 0x7f7754153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40918/0 (socket says 172.21.15.63:40918) 2024-09-21T07:00:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f775259c640 1 -- 172.21.15.63:0/2883397285 learned_addr learned my addr 172.21.15.63:0/2883397285 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f7752d9d640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77540caa50 0x7f77541f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f775359e640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77540b53a0 0x7f77540b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f775259c640 1 -- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77540caa50 msgr2=0x7f77541f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f775259c640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77540caa50 0x7f77541f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f775259c640 1 -- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77540b53a0 msgr2=0x7f77540b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f775259c640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77540b53a0 0x7f77540b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f775259c640 1 -- 172.21.15.63:0/2883397285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77540b5cf0 con 0x7f7754153280 2024-09-21T07:00:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f775259c640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7754153280 0x7f7754153690 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7748011ae0 tx=0x7f7748009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.006+0000 7f773b7fe640 1 -- 172.21.15.63:0/2883397285 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774801e070 con 0x7f7754153280 2024-09-21T07:00:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.007+0000 7f773b7fe640 1 -- 172.21.15.63:0/2883397285 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7748004460 con 0x7f7754153280 2024-09-21T07:00:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.007+0000 7f77591c2640 1 -- 172.21.15.63:0/2883397285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77540cb1a0 con 0x7f7754153280 2024-09-21T07:00:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.007+0000 7f773b7fe640 1 -- 172.21.15.63:0/2883397285 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774800fc60 con 0x7f7754153280 2024-09-21T07:00:46.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.007+0000 7f77591c2640 1 -- 172.21.15.63:0/2883397285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77541f9400 con 0x7f7754153280 2024-09-21T07:00:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.008+0000 7f77591c2640 1 -- 172.21.15.63:0/2883397285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7754069f20 con 0x7f7754153280 2024-09-21T07:00:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.008+0000 7f773b7fe640 1 -- 172.21.15.63:0/2883397285 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7748021070 con 0x7f7754153280 2024-09-21T07:00:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.009+0000 7f773b7fe640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7740078b90 0x7f774007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.009+0000 7f773b7fe640 1 -- 172.21.15.63:0/2883397285 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f774809b7b0 con 0x7f7754153280 2024-09-21T07:00:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.009+0000 7f7752d9d640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7740078b90 0x7f774007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:46.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.010+0000 7f7752d9d640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7740078b90 0x7f774007b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f77540c97a0 tx=0x7f7744005f30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:46.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.014+0000 7f773b7fe640 1 -- 172.21.15.63:0/2883397285 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7754069f20 con 0x7f7754153280 2024-09-21T07:00:46.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.203+0000 7f77591c2640 1 -- 172.21.15.63:0/2883397285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77540b2a60 con 0x7f7754153280 2024-09-21T07:00:46.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.204+0000 7f773b7fe640 1 -- 172.21.15.63:0/2883397285 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7f77540b5cf0 con 0x7f7754153280 2024-09-21T07:00:46.206 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:46.207 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:00:22.544759+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:00:18.869431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:00:19.879189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:00:46.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.206+0000 7f77591c2640 1 -- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7740078b90 msgr2=0x7f774007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.206+0000 7f77591c2640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7740078b90 0x7f774007b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f77540c97a0 tx=0x7f7744005f30 comp rx=0 tx=0).stop 2024-09-21T07:00:46.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.206+0000 7f77591c2640 1 -- 172.21.15.63:0/2883397285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7754153280 msgr2=0x7f7754153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.206+0000 7f77591c2640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7754153280 0x7f7754153690 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7748011ae0 tx=0x7f7748009e40 comp rx=0 tx=0).stop 2024-09-21T07:00:46.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.206+0000 7f77591c2640 1 -- 172.21.15.63:0/2883397285 shutdown_connections 2024-09-21T07:00:46.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.206+0000 7f77591c2640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7740078b90 0x7f774007b0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.206+0000 7f77591c2640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77540b53a0 0x7f77540b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.206+0000 7f77591c2640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7754153280 0x7f7754153690 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.206+0000 7f77591c2640 1 --2- 172.21.15.63:0/2883397285 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f77540caa50 0x7f77541f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.206+0000 7f77591c2640 1 -- 172.21.15.63:0/2883397285 >> 172.21.15.63:0/2883397285 conn(0x7f775408bfd0 msgr2=0x7f77540b9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:46.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.207+0000 7f77591c2640 1 -- 172.21.15.63:0/2883397285 shutdown_connections 2024-09-21T07:00:46.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.207+0000 7f77591c2640 1 -- 172.21.15.63:0/2883397285 wait complete. 2024-09-21T07:00:46.220 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T07:00:10.613861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T07:00:18.869431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T07:00:19.879189+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T07:00:46.220 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T07:00:46.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.338+0000 7fbd1fd58640 1 -- 172.21.15.63:0/1327917238 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd180d2c40 msgr2=0x7fbd181698f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.338+0000 7fbd1fd58640 1 --2- 172.21.15.63:0/1327917238 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd180d2c40 0x7fbd181698f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009be0 tx=0x7fbd1002a8b0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.338+0000 7fbd1fd58640 1 -- 172.21.15.63:0/1327917238 shutdown_connections 2024-09-21T07:00:46.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.338+0000 7fbd1fd58640 1 --2- 172.21.15.63:0/1327917238 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd180d2c40 0x7fbd181698f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.338+0000 7fbd1fd58640 1 -- 172.21.15.63:0/1327917238 >> 172.21.15.63:0/1327917238 conn(0x7fbd1808bfd0 msgr2=0x7fbd180d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.338+0000 7fbd1fd58640 1 -- 172.21.15.63:0/1327917238 shutdown_connections 2024-09-21T07:00:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.338+0000 7fbd1fd58640 1 -- 172.21.15.63:0/1327917238 wait complete. 2024-09-21T07:00:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.340+0000 7fbd1fd58640 1 Processor -- start 2024-09-21T07:00:46.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.340+0000 7fbd1fd58640 1 -- start start 2024-09-21T07:00:46.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.341+0000 7fbd1fd58640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd180b7530 0x7fbd1814d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:46.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.341+0000 7fbd1fd58640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd180d2c40 0x7fbd181f9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:46.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.341+0000 7fbd1fd58640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1815ef00 0x7fbd181f96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:46.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.341+0000 7fbd1fd58640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1816a040 con 0x7fbd1815ef00 2024-09-21T07:00:46.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.341+0000 7fbd1fd58640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbd180d5560 con 0x7fbd180b7530 2024-09-21T07:00:46.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.341+0000 7fbd1fd58640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbd1816a1c0 con 0x7fbd180d2c40 2024-09-21T07:00:46.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.341+0000 7fbd1e2f5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1815ef00 0x7fbd181f96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.341+0000 7fbd1e2f5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1815ef00 0x7fbd181f96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40926/0 (socket says 172.21.15.63:40926) 2024-09-21T07:00:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.341+0000 7fbd1e2f5640 1 -- 172.21.15.63:0/663185169 learned_addr learned my addr 172.21.15.63:0/663185169 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.341+0000 7fbd1daf4640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd180b7530 0x7fbd1814d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.341+0000 7fbd1d2f3640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd180d2c40 0x7fbd181f9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.342+0000 7fbd1e2f5640 1 -- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd180d2c40 msgr2=0x7fbd181f9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.342+0000 7fbd1e2f5640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd180d2c40 0x7fbd181f9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.342+0000 7fbd1e2f5640 1 -- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd180b7530 msgr2=0x7fbd1814d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.342+0000 7fbd1e2f5640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd180b7530 0x7fbd1814d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.342+0000 7fbd1e2f5640 1 -- 172.21.15.63:0/663185169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd181554f0 con 0x7fbd1815ef00 2024-09-21T07:00:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.342+0000 7fbd1e2f5640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1815ef00 0x7fbd181f96d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009be0 tx=0x7fbd10003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.342+0000 7fbd0e7fc640 1 -- 172.21.15.63:0/663185169 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd10042020 con 0x7fbd1815ef00 2024-09-21T07:00:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.342+0000 7fbd0e7fc640 1 -- 172.21.15.63:0/663185169 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd10033b00 con 0x7fbd1815ef00 2024-09-21T07:00:46.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.342+0000 7fbd0e7fc640 1 -- 172.21.15.63:0/663185169 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd10037040 con 0x7fbd1815ef00 2024-09-21T07:00:46.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.342+0000 7fbd1fd58640 1 -- 172.21.15.63:0/663185169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd181557d0 con 0x7fbd1815ef00 2024-09-21T07:00:46.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.342+0000 7fbd1fd58640 1 -- 172.21.15.63:0/663185169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd18154230 con 0x7fbd1815ef00 2024-09-21T07:00:46.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.343+0000 7fbd1fd58640 1 -- 172.21.15.63:0/663185169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd18155260 con 0x7fbd1815ef00 2024-09-21T07:00:46.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.344+0000 7fbd0e7fc640 1 -- 172.21.15.63:0/663185169 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd10045020 con 0x7fbd1815ef00 2024-09-21T07:00:46.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.344+0000 7fbd0e7fc640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:46.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.344+0000 7fbd0e7fc640 1 -- 172.21.15.63:0/663185169 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbd100bb780 con 0x7fbd1815ef00 2024-09-21T07:00:46.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.345+0000 7fbd1daf4640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:46.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.345+0000 7fbd1daf4640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbd14007fd0 tx=0x7fbd14009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:46.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.349+0000 7fbd0e7fc640 1 -- 172.21.15.63:0/663185169 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbd1004c030 con 0x7fbd1815ef00 2024-09-21T07:00:46.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.538+0000 7fbd1fd58640 1 -- 172.21.15.63:0/663185169 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbd1806a130 con 0x7fbd1815ef00 2024-09-21T07:00:46.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.538+0000 7fbd0e7fc640 1 -- 172.21.15.63:0/663185169 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fbd10083600 con 0x7fbd1815ef00 2024-09-21T07:00:46.540 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2024-09-21T07:00:46.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.541+0000 7fbd1fd58640 1 -- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbcfc078b90 msgr2=0x7fbcfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.541+0000 7fbd1fd58640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbd14007fd0 tx=0x7fbd14009040 comp rx=0 tx=0).stop 2024-09-21T07:00:46.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.541+0000 7fbd1fd58640 1 -- 172.21.15.63:0/663185169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1815ef00 msgr2=0x7fbd181f96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.541+0000 7fbd1fd58640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1815ef00 0x7fbd181f96d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009be0 tx=0x7fbd10003e70 comp rx=0 tx=0).stop 2024-09-21T07:00:46.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.541+0000 7fbd1fd58640 1 -- 172.21.15.63:0/663185169 shutdown_connections 2024-09-21T07:00:46.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.541+0000 7fbd1fd58640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbcfc078b90 0x7fbcfc07b0a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.541+0000 7fbd1fd58640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd1815ef00 0x7fbd181f96d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.541+0000 7fbd1fd58640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbd180d2c40 0x7fbd181f9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.541+0000 7fbd1fd58640 1 --2- 172.21.15.63:0/663185169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd180b7530 0x7fbd1814d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.541+0000 7fbd1fd58640 1 -- 172.21.15.63:0/663185169 >> 172.21.15.63:0/663185169 conn(0x7fbd1808bfd0 msgr2=0x7fbd1815e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:46.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.541+0000 7fbd1fd58640 1 -- 172.21.15.63:0/663185169 shutdown_connections 2024-09-21T07:00:46.543 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.541+0000 7fbd1fd58640 1 -- 172.21.15.63:0/663185169 wait complete. 2024-09-21T07:00:46.554 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T07:00:46.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.671+0000 7f1ea06be640 1 -- 172.21.15.63:0/1079625521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e80004800 msgr2=0x7f1e80004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.671+0000 7f1ea06be640 1 --2- 172.21.15.63:0/1079625521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e80004800 0x7f1e80004c10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00bb20 tx=0x7f1e80005830 comp rx=0 tx=0).stop 2024-09-21T07:00:46.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.671+0000 7f1e9ec5b640 1 -- 172.21.15.63:0/1079625521 reap_dead start 2024-09-21T07:00:46.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.671+0000 7f1ea06be640 1 -- 172.21.15.63:0/1079625521 shutdown_connections 2024-09-21T07:00:46.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.671+0000 7f1ea06be640 1 -- 172.21.15.63:0/1079625521 >> 172.21.15.63:0/1079625521 conn(0x7f1e980b3fb0 msgr2=0x7f1e980b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:46.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.672+0000 7f1ea06be640 1 -- 172.21.15.63:0/1079625521 shutdown_connections 2024-09-21T07:00:46.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.672+0000 7f1ea06be640 1 -- 172.21.15.63:0/1079625521 wait complete. 2024-09-21T07:00:46.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.673+0000 7f1ea06be640 1 Processor -- start 2024-09-21T07:00:46.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.673+0000 7f1ea06be640 1 -- start start 2024-09-21T07:00:46.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1ea06be640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e80004800 0x7f1e98159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:46.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1ea06be640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e9815f0d0 0x7f1e9815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:46.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1ea06be640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e981566c0 0x7f1e98156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:46.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1ea06be640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1e980cd0b0 con 0x7f1e80004800 2024-09-21T07:00:46.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1ea06be640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1e980ccf30 con 0x7f1e9815f0d0 2024-09-21T07:00:46.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1ea06be640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1e98163560 con 0x7f1e981566c0 2024-09-21T07:00:46.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e9e45a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e80004800 0x7f1e98159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:46.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e9e45a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e80004800 0x7f1e98159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40938/0 (socket says 172.21.15.63:40938) 2024-09-21T07:00:46.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e9e45a640 1 -- 172.21.15.63:0/2960026286 learned_addr learned my addr 172.21.15.63:0/2960026286 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e9dc59640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e9815f0d0 0x7f1e9815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e9ec5b640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e981566c0 0x7f1e98156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e9e45a640 1 -- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e981566c0 msgr2=0x7f1e98156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e9e45a640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e981566c0 0x7f1e98156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e9e45a640 1 -- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e9815f0d0 msgr2=0x7f1e9815f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e9e45a640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e9815f0d0 0x7f1e9815f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e9e45a640 1 -- 172.21.15.63:0/2960026286 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e98157810 con 0x7f1e80004800 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e9dc59640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e9815f0d0 0x7f1e9815f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e9e45a640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e80004800 0x7f1e98159210 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1e88006090 tx=0x7f1e88006550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e96ffd640 1 -- 172.21.15.63:0/2960026286 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e88015070 con 0x7f1e80004800 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1e96ffd640 1 -- 172.21.15.63:0/2960026286 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e8800fa90 con 0x7f1e80004800 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.675+0000 7f1ea06be640 1 -- 172.21.15.63:0/2960026286 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e98157af0 con 0x7f1e80004800 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.676+0000 7f1e96ffd640 1 -- 172.21.15.63:0/2960026286 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e88011430 con 0x7f1e80004800 2024-09-21T07:00:46.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.676+0000 7f1ea06be640 1 -- 172.21.15.63:0/2960026286 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e981580b0 con 0x7f1e80004800 2024-09-21T07:00:46.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.676+0000 7f1ea06be640 1 -- 172.21.15.63:0/2960026286 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e9809aa40 con 0x7f1e80004800 2024-09-21T07:00:46.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.677+0000 7f1e96ffd640 1 -- 172.21.15.63:0/2960026286 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1e880115d0 con 0x7f1e80004800 2024-09-21T07:00:46.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.678+0000 7f1e96ffd640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1e84078b90 0x7f1e8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:46.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.678+0000 7f1e96ffd640 1 -- 172.21.15.63:0/2960026286 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1e8809bbb0 con 0x7f1e80004800 2024-09-21T07:00:46.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.678+0000 7f1e9dc59640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1e84078b90 0x7f1e8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:46.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.678+0000 7f1e9dc59640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1e84078b90 0x7f1e8407b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c036000 tx=0x7f1e8c0046c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:46.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.682+0000 7f1e96ffd640 1 -- 172.21.15.63:0/2960026286 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1e88064080 con 0x7f1e80004800 2024-09-21T07:00:46.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.869+0000 7f1ea06be640 1 -- 172.21.15.63:0/2960026286 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1e9806a130 con 0x7f1e80004800 2024-09-21T07:00:46.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.870+0000 7f1e96ffd640 1 -- 172.21.15.63:0/2960026286 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f1e88063980 con 0x7f1e80004800 2024-09-21T07:00:46.871 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2024-09-21T07:00:46.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.872+0000 7f1ea06be640 1 -- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1e84078b90 msgr2=0x7f1e8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.872+0000 7f1ea06be640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1e84078b90 0x7f1e8407b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c036000 tx=0x7f1e8c0046c0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.872+0000 7f1ea06be640 1 -- 172.21.15.63:0/2960026286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e80004800 msgr2=0x7f1e98159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:46.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.872+0000 7f1ea06be640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e80004800 0x7f1e98159210 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1e88006090 tx=0x7f1e88006550 comp rx=0 tx=0).stop 2024-09-21T07:00:46.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.872+0000 7f1ea06be640 1 -- 172.21.15.63:0/2960026286 shutdown_connections 2024-09-21T07:00:46.874 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.872+0000 7f1ea06be640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1e84078b90 0x7f1e8407b0a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.872+0000 7f1ea06be640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1e981566c0 0x7f1e98156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.872+0000 7f1ea06be640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1e9815f0d0 0x7f1e9815f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.872+0000 7f1ea06be640 1 --2- 172.21.15.63:0/2960026286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1e80004800 0x7f1e98159210 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:46.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.872+0000 7f1ea06be640 1 -- 172.21.15.63:0/2960026286 >> 172.21.15.63:0/2960026286 conn(0x7f1e980b3fb0 msgr2=0x7f1e980722b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:46.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.872+0000 7f1ea06be640 1 -- 172.21.15.63:0/2960026286 shutdown_connections 2024-09-21T07:00:46.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:46.872+0000 7f1ea06be640 1 -- 172.21.15.63:0/2960026286 wait complete. 2024-09-21T07:00:46.885 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T07:00:47.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.002+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/3504053761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6f80d1300 msgr2=0x7fc6f806e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.002+0000 7fc6fc8bd640 1 --2- 172.21.15.63:0/3504053761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6f80d1300 0x7fc6f806e930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8005fd0 tx=0x7fc6e802a820 comp rx=0 tx=0).stop 2024-09-21T07:00:47.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.002+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/3504053761 shutdown_connections 2024-09-21T07:00:47.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.002+0000 7fc6fc8bd640 1 --2- 172.21.15.63:0/3504053761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6f80d1300 0x7fc6f806e930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.002+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/3504053761 >> 172.21.15.63:0/3504053761 conn(0x7fc6f80d45e0 msgr2=0x7fc6f80d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:47.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.002+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/3504053761 shutdown_connections 2024-09-21T07:00:47.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.002+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/3504053761 wait complete. 2024-09-21T07:00:47.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.004+0000 7fc6fc8bd640 1 Processor -- start 2024-09-21T07:00:47.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.004+0000 7fc6fc8bd640 1 -- start start 2024-09-21T07:00:47.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6fc8bd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc6f80b3aa0 0x7fc6f81f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6fc8bd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6f80b9aa0 0x7fc6f81e9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6fc8bd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6f80c8b80 0x7fc6f81e9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6fc8bd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f806ee70 con 0x7fc6f80c8b80 2024-09-21T07:00:47.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6fc8bd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f808cbf0 con 0x7fc6f80b9aa0 2024-09-21T07:00:47.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6fc8bd640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f806eff0 con 0x7fc6f80b3aa0 2024-09-21T07:00:47.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6f6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6f80c8b80 0x7fc6f81e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6f6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6f80c8b80 0x7fc6f81e9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40950/0 (socket says 172.21.15.63:40950) 2024-09-21T07:00:47.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6f6d9d640 1 -- 172.21.15.63:0/4250810321 learned_addr learned my addr 172.21.15.63:0/4250810321 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:47.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6f5d9b640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6f80b9aa0 0x7fc6f81e9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6f659c640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc6f80b3aa0 0x7fc6f81f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6f6d9d640 1 -- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc6f80b3aa0 msgr2=0x7fc6f81f5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6f6d9d640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc6f80b3aa0 0x7fc6f81f5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6f6d9d640 1 -- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6f80b9aa0 msgr2=0x7fc6f81e9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6f6d9d640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6f80b9aa0 0x7fc6f81e9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6f6d9d640 1 -- 172.21.15.63:0/4250810321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f81e8460 con 0x7fc6f80c8b80 2024-09-21T07:00:47.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6f659c640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc6f80b3aa0 0x7fc6f81f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:47.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6f6d9d640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6f80c8b80 0x7fc6f81e9760 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009cd0 tx=0x7fc6e8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:47.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6eeffd640 1 -- 172.21.15.63:0/4250810321 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8037040 con 0x7fc6f80c8b80 2024-09-21T07:00:47.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6eeffd640 1 -- 172.21.15.63:0/4250810321 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6e8042070 con 0x7fc6f80c8b80 2024-09-21T07:00:47.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.006+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/4250810321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f81e8740 con 0x7fc6f80c8b80 2024-09-21T07:00:47.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.007+0000 7fc6eeffd640 1 -- 172.21.15.63:0/4250810321 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8004280 con 0x7fc6f80c8b80 2024-09-21T07:00:47.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.007+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/4250810321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f80c9030 con 0x7fc6f80c8b80 2024-09-21T07:00:47.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.008+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/4250810321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f806e930 con 0x7fc6f80c8b80 2024-09-21T07:00:47.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.008+0000 7fc6eeffd640 1 -- 172.21.15.63:0/4250810321 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6e8004420 con 0x7fc6f80c8b80 2024-09-21T07:00:47.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.009+0000 7fc6eeffd640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc6d8078b90 0x7fc6d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.009+0000 7fc6eeffd640 1 -- 172.21.15.63:0/4250810321 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc6e80bbab0 con 0x7fc6f80c8b80 2024-09-21T07:00:47.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.009+0000 7fc6f659c640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc6d8078b90 0x7fc6d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.010+0000 7fc6f659c640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc6d8078b90 0x7fc6d807b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009890 tx=0x7fc6f0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:47.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.014+0000 7fc6eeffd640 1 -- 172.21.15.63:0/4250810321 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc6e8083f90 con 0x7fc6f80c8b80 2024-09-21T07:00:47.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.203+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/4250810321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc6f80b93b0 con 0x7fc6f80c8b80 2024-09-21T07:00:47.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.203+0000 7fc6eeffd640 1 -- 172.21.15.63:0/4250810321 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fc6e8083890 con 0x7fc6f80c8b80 2024-09-21T07:00:47.205 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2024-09-21T07:00:47.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.205+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc6d8078b90 msgr2=0x7fc6d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.205+0000 7fc6fc8bd640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc6d8078b90 0x7fc6d807b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009890 tx=0x7fc6f0008040 comp rx=0 tx=0).stop 2024-09-21T07:00:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.205+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/4250810321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6f80c8b80 msgr2=0x7fc6f81e9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.205+0000 7fc6fc8bd640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6f80c8b80 0x7fc6f81e9760 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009cd0 tx=0x7fc6e8032d10 comp rx=0 tx=0).stop 2024-09-21T07:00:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.205+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/4250810321 shutdown_connections 2024-09-21T07:00:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.205+0000 7fc6fc8bd640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc6d8078b90 0x7fc6d807b0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.205+0000 7fc6fc8bd640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc6f80c8b80 0x7fc6f81e9760 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.205+0000 7fc6fc8bd640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6f80b9aa0 0x7fc6f81e9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.205+0000 7fc6fc8bd640 1 --2- 172.21.15.63:0/4250810321 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc6f80b3aa0 0x7fc6f81f5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.206+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/4250810321 >> 172.21.15.63:0/4250810321 conn(0x7fc6f80d45e0 msgr2=0x7fc6f815e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.206+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/4250810321 shutdown_connections 2024-09-21T07:00:47.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.206+0000 7fc6fc8bd640 1 -- 172.21.15.63:0/4250810321 wait complete. 2024-09-21T07:00:47.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal' 2024-09-21T07:00:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.335+0000 7f6c2b313640 1 -- 172.21.15.63:0/3270505736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c10004800 msgr2=0x7f6c10004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.335+0000 7f6c2b313640 1 --2- 172.21.15.63:0/3270505736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c10004800 0x7f6c10004c10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009b50 tx=0x7f6c10005830 comp rx=0 tx=0).stop 2024-09-21T07:00:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.335+0000 7f6c2b313640 1 -- 172.21.15.63:0/3270505736 shutdown_connections 2024-09-21T07:00:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.335+0000 7f6c2b313640 1 --2- 172.21.15.63:0/3270505736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c10004800 0x7f6c10004c10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.335+0000 7f6c2b313640 1 -- 172.21.15.63:0/3270505736 >> 172.21.15.63:0/3270505736 conn(0x7f6c240d45e0 msgr2=0x7f6c240d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:47.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.335+0000 7f6c2b313640 1 -- 172.21.15.63:0/3270505736 shutdown_connections 2024-09-21T07:00:47.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.335+0000 7f6c2b313640 1 -- 172.21.15.63:0/3270505736 wait complete. 2024-09-21T07:00:47.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.337+0000 7f6c2b313640 1 Processor -- start 2024-09-21T07:00:47.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.337+0000 7f6c2b313640 1 -- start start 2024-09-21T07:00:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.338+0000 7f6c2b313640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c10004800 0x7f6c241f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.338+0000 7f6c2b313640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c240cb920 0x7f6c241f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.338+0000 7f6c2b313640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c240ca120 0x7f6c240ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.338+0000 7f6c2b313640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6c240d0bf0 con 0x7f6c10004800 2024-09-21T07:00:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.338+0000 7f6c2b313640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c240d0d70 con 0x7f6c240ca120 2024-09-21T07:00:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.338+0000 7f6c2b313640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6c240d0ef0 con 0x7f6c240cb920 2024-09-21T07:00:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.338+0000 7f6c290af640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c10004800 0x7f6c241f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.338+0000 7f6c290af640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c10004800 0x7f6c241f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40964/0 (socket says 172.21.15.63:40964) 2024-09-21T07:00:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.338+0000 7f6c290af640 1 -- 172.21.15.63:0/122201383 learned_addr learned my addr 172.21.15.63:0/122201383 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.338+0000 7f6c288ae640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c240cb920 0x7f6c241f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.338+0000 7f6c298b0640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c240ca120 0x7f6c240ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.339+0000 7f6c290af640 1 -- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c240cb920 msgr2=0x7f6c241f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.339+0000 7f6c290af640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c240cb920 0x7f6c241f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.339+0000 7f6c290af640 1 -- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c240ca120 msgr2=0x7f6c240ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.339+0000 7f6c290af640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c240ca120 0x7f6c240ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.339+0000 7f6c290af640 1 -- 172.21.15.63:0/122201383 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c240caa70 con 0x7f6c10004800 2024-09-21T07:00:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.339+0000 7f6c290af640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c10004800 0x7f6c241f5e70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6c20001a50 tx=0x7f6c200039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.339+0000 7f6c19ffb640 1 -- 172.21.15.63:0/122201383 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20015070 con 0x7f6c10004800 2024-09-21T07:00:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.339+0000 7f6c19ffb640 1 -- 172.21.15.63:0/122201383 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c20011860 con 0x7f6c10004800 2024-09-21T07:00:47.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.339+0000 7f6c2b313640 1 -- 172.21.15.63:0/122201383 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c241f66c0 con 0x7f6c10004800 2024-09-21T07:00:47.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.339+0000 7f6c19ffb640 1 -- 172.21.15.63:0/122201383 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20011cb0 con 0x7f6c10004800 2024-09-21T07:00:47.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.339+0000 7f6c2b313640 1 -- 172.21.15.63:0/122201383 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c241f6c80 con 0x7f6c10004800 2024-09-21T07:00:47.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.340+0000 7f6c2b313640 1 -- 172.21.15.63:0/122201383 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c24074980 con 0x7f6c10004800 2024-09-21T07:00:47.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.341+0000 7f6c19ffb640 1 -- 172.21.15.63:0/122201383 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c20018070 con 0x7f6c10004800 2024-09-21T07:00:47.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.342+0000 7f6c19ffb640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6c08078bc0 0x7f6c0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.342+0000 7f6c19ffb640 1 -- 172.21.15.63:0/122201383 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6c2009b8b0 con 0x7f6c10004800 2024-09-21T07:00:47.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.342+0000 7f6c288ae640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6c08078bc0 0x7f6c0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.342+0000 7f6c288ae640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6c08078bc0 0x7f6c0807b0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6c14035000 tx=0x7f6c140046c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:47.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.346+0000 7f6c19ffb640 1 -- 172.21.15.63:0/122201383 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6c24074980 con 0x7f6c10004800 2024-09-21T07:00:47.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.610+0000 7f6c2b313640 1 -- 172.21.15.63:0/122201383 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]} v 0) -- 0x7f6c240d1450 con 0x7f6c10004800 2024-09-21T07:00:47.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.693+0000 7f6c19ffb640 1 -- 172.21.15.63:0/122201383 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]}]=0 v45) ==== 162+0+0 (secure 0 0 0) 0x7f6c240caa70 con 0x7f6c10004800 2024-09-21T07:00:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.697+0000 7f6c2b313640 1 -- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6c08078bc0 msgr2=0x7f6c0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.697+0000 7f6c2b313640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6c08078bc0 0x7f6c0807b0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6c14035000 tx=0x7f6c140046c0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.697+0000 7f6c2b313640 1 -- 172.21.15.63:0/122201383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c10004800 msgr2=0x7f6c241f5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.697+0000 7f6c2b313640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c10004800 0x7f6c241f5e70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6c20001a50 tx=0x7f6c200039c0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.697+0000 7f6c2b313640 1 -- 172.21.15.63:0/122201383 shutdown_connections 2024-09-21T07:00:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.697+0000 7f6c2b313640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6c08078bc0 0x7f6c0807b0d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.697+0000 7f6c2b313640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c240ca120 0x7f6c240ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.697+0000 7f6c2b313640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6c240cb920 0x7f6c241f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.697+0000 7f6c2b313640 1 --2- 172.21.15.63:0/122201383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c10004800 0x7f6c241f5e70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.697+0000 7f6c2b313640 1 -- 172.21.15.63:0/122201383 >> 172.21.15.63:0/122201383 conn(0x7f6c240d45e0 msgr2=0x7f6c240b9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:47.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.697+0000 7f6c2b313640 1 -- 172.21.15.63:0/122201383 shutdown_connections 2024-09-21T07:00:47.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.697+0000 7f6c2b313640 1 -- 172.21.15.63:0/122201383 wait complete. 2024-09-21T07:00:47.710 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-21T07:00:47.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.824+0000 7f0b1c590640 1 -- 172.21.15.63:0/3145826074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b14070f10 msgr2=0x7f0b140cf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.824+0000 7f0b1c590640 1 --2- 172.21.15.63:0/3145826074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b14070f10 0x7f0b140cf260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c005fd0 tx=0x7f0b0c02aa90 comp rx=0 tx=0).stop 2024-09-21T07:00:47.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.824+0000 7f0b1c590640 1 -- 172.21.15.63:0/3145826074 shutdown_connections 2024-09-21T07:00:47.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.824+0000 7f0b1c590640 1 --2- 172.21.15.63:0/3145826074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b14070f10 0x7f0b140cf260 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.824+0000 7f0b1c590640 1 --2- 172.21.15.63:0/3145826074 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b14068d00 0x7f0b1415b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.824+0000 7f0b1c590640 1 -- 172.21.15.63:0/3145826074 >> 172.21.15.63:0/3145826074 conn(0x7f0b140b2790 msgr2=0x7f0b140b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:47.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.825+0000 7f0b1c590640 1 -- 172.21.15.63:0/3145826074 shutdown_connections 2024-09-21T07:00:47.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.825+0000 7f0b1c590640 1 -- 172.21.15.63:0/3145826074 wait complete. 2024-09-21T07:00:47.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.826+0000 7f0b1c590640 1 Processor -- start 2024-09-21T07:00:47.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.826+0000 7f0b1c590640 1 -- start start 2024-09-21T07:00:47.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1c590640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b14068d00 0x7f0b14149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1c590640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b14070b00 0x7f0b141f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1c590640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b14070f10 0x7f0b14147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1c590640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0b140b4160 con 0x7f0b14070f10 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1c590640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0b140b3fe0 con 0x7f0b14070b00 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1c590640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0b140b42e0 con 0x7f0b14068d00 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1ab2d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b14070f10 0x7f0b14147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1ab2d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b14070f10 0x7f0b14147bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40976/0 (socket says 172.21.15.63:40976) 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1ab2d640 1 -- 172.21.15.63:0/1365438672 learned_addr learned my addr 172.21.15.63:0/1365438672 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1a32c640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b14068d00 0x7f0b14149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b19b2b640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b14070b00 0x7f0b141f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1ab2d640 1 -- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b14068d00 msgr2=0x7f0b14149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1ab2d640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b14068d00 0x7f0b14149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1ab2d640 1 -- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b14070b00 msgr2=0x7f0b141f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:47.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1ab2d640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b14070b00 0x7f0b141f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:47.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1ab2d640 1 -- 172.21.15.63:0/1365438672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1414a140 con 0x7f0b14070f10 2024-09-21T07:00:47.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b1ab2d640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b14070f10 0x7f0b14147bb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009bf0 tx=0x7f0b0c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:47.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.828+0000 7f0b0affd640 1 -- 172.21.15.63:0/1365438672 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c044070 con 0x7f0b14070f10 2024-09-21T07:00:47.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.829+0000 7f0b0affd640 1 -- 172.21.15.63:0/1365438672 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b0c003e00 con 0x7f0b14070f10 2024-09-21T07:00:47.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.829+0000 7f0b1c590640 1 -- 172.21.15.63:0/1365438672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1414a620 con 0x7f0b14070f10 2024-09-21T07:00:47.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.829+0000 7f0b0affd640 1 -- 172.21.15.63:0/1365438672 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c0044b0 con 0x7f0b14070f10 2024-09-21T07:00:47.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.829+0000 7f0b1c590640 1 -- 172.21.15.63:0/1365438672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b141f6db0 con 0x7f0b14070f10 2024-09-21T07:00:47.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.829+0000 7f0b1c590640 1 -- 172.21.15.63:0/1365438672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b1414a390 con 0x7f0b14070f10 2024-09-21T07:00:47.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.830+0000 7f0b0affd640 1 -- 172.21.15.63:0/1365438672 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b0c047070 con 0x7f0b14070f10 2024-09-21T07:00:47.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.831+0000 7f0b0affd640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0af8078b90 0x7f0af807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:47.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.831+0000 7f0b0affd640 1 -- 172.21.15.63:0/1365438672 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0b0c0bbd00 con 0x7f0b14070f10 2024-09-21T07:00:47.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.831+0000 7f0b1a32c640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0af8078b90 0x7f0af807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:47.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.832+0000 7f0b1a32c640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0af8078b90 0x7f0af807b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0b100095f0 tx=0x7f0b10005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:47.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:47.836+0000 7f0b0affd640 1 -- 172.21.15.63:0/1365438672 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0b1414a140 con 0x7f0b14070f10 2024-09-21T07:00:48.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:00:48.007 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:00:48.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.021+0000 7f0b1c590640 1 -- 172.21.15.63:0/1365438672 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f0b1414ab40 con 0x7f0b14070f10 2024-09-21T07:00:48.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.022+0000 7f0b0affd640 1 -- 172.21.15.63:0/1365438672 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7f0b1414ab40 con 0x7f0b14070f10 2024-09-21T07:00:48.024 INFO:teuthology.orchestra.run.smithi063.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T07:00:48.024 INFO:teuthology.orchestra.run.smithi063.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T07:00:48.024 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced client_mount_timeout 30 2024-09-21T07:00:48.024 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_client 20/20 2024-09-21T07:00:48.024 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_mgr 20/20 2024-09-21T07:00:48.024 INFO:teuthology.orchestra.run.smithi063.stdout:mgr advanced debug_ms 1/1 2024-09-21T07:00:48.024 INFO:teuthology.orchestra.run.smithi063.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T07:00:48.024 INFO:teuthology.orchestra.run.smithi063.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T07:00:48.024 INFO:teuthology.orchestra.run.smithi063.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4554.424090 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4320.610959 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4378.591000 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4177.043557 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 7691.774218 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5100.920245 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5701.169918 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5624.717783 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_mds 20/20 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced debug_ms 2/2 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_debug_frag true 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_debug_scatterstat true 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T07:00:48.025 INFO:teuthology.orchestra.run.smithi063.stdout:mds dev mds_verify_scatter true 2024-09-21T07:00:48.026 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T07:00:48.026 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T07:00:48.026 INFO:teuthology.orchestra.run.smithi063.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T07:00:48.026 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced client_mount_timeout 600 2024-09-21T07:00:48.026 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced debug_client 20/20 2024-09-21T07:00:48.026 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced debug_ms 1/1 2024-09-21T07:00:48.026 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T07:00:48.026 INFO:teuthology.orchestra.run.smithi063.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T07:00:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.024+0000 7f0b1c590640 1 -- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0af8078b90 msgr2=0x7f0af807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.024+0000 7f0b1c590640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0af8078b90 0x7f0af807b0a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0b100095f0 tx=0x7f0b10005f90 comp rx=0 tx=0).stop 2024-09-21T07:00:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.024+0000 7f0b1c590640 1 -- 172.21.15.63:0/1365438672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b14070f10 msgr2=0x7f0b14147bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.024+0000 7f0b1c590640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b14070f10 0x7f0b14147bb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009bf0 tx=0x7f0b0c003c10 comp rx=0 tx=0).stop 2024-09-21T07:00:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.024+0000 7f0b1c590640 1 -- 172.21.15.63:0/1365438672 shutdown_connections 2024-09-21T07:00:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.024+0000 7f0b1c590640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0af8078b90 0x7f0af807b0a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.024+0000 7f0b1c590640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b14070f10 0x7f0b14147bb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.024+0000 7f0b1c590640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b14070b00 0x7f0b141f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.024+0000 7f0b1c590640 1 --2- 172.21.15.63:0/1365438672 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b14068d00 0x7f0b14149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.024+0000 7f0b1c590640 1 -- 172.21.15.63:0/1365438672 >> 172.21.15.63:0/1365438672 conn(0x7f0b140b2790 msgr2=0x7f0b14158f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:48.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.024+0000 7f0b1c590640 1 -- 172.21.15.63:0/1365438672 shutdown_connections 2024-09-21T07:00:48.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.024+0000 7f0b1c590640 1 -- 172.21.15.63:0/1365438672 wait complete. 2024-09-21T07:00:48.038 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-21T07:00:48.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.220+0000 7fe8c523f640 1 -- 172.21.15.63:0/1172123030 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8ac0053d0 msgr2=0x7fe8ac00ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:48.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.220+0000 7fe8c523f640 1 --2- 172.21.15.63:0/1172123030 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8ac0053d0 0x7fe8ac00ba80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800c640 tx=0x7fe8ac005830 comp rx=0 tx=0).stop 2024-09-21T07:00:48.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.220+0000 7fe8c523f640 1 -- 172.21.15.63:0/1172123030 shutdown_connections 2024-09-21T07:00:48.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.220+0000 7fe8c523f640 1 --2- 172.21.15.63:0/1172123030 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8ac0053d0 0x7fe8ac00ba80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.220+0000 7fe8c523f640 1 -- 172.21.15.63:0/1172123030 >> 172.21.15.63:0/1172123030 conn(0x7fe8c00d45e0 msgr2=0x7fe8c00d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:48.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.220+0000 7fe8c523f640 1 -- 172.21.15.63:0/1172123030 shutdown_connections 2024-09-21T07:00:48.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.220+0000 7fe8c523f640 1 -- 172.21.15.63:0/1172123030 wait complete. 2024-09-21T07:00:48.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.222+0000 7fe8c523f640 1 Processor -- start 2024-09-21T07:00:48.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.223+0000 7fe8c523f640 1 -- start start 2024-09-21T07:00:48.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8c523f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8ac0053d0 0x7fe8c0155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:48.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8c523f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8c00ce1c0 0x7fe8c00ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8c523f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8c00ca7e0 0x7fe8c01f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8c523f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c00d3410 con 0x7fe8ac0053d0 2024-09-21T07:00:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8c523f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c00d3290 con 0x7fe8c00ca7e0 2024-09-21T07:00:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8c523f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c00d3590 con 0x7fe8c00ce1c0 2024-09-21T07:00:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8bed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8ac0053d0 0x7fe8c0155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8bed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8ac0053d0 0x7fe8c0155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40998/0 (socket says 172.21.15.63:40998) 2024-09-21T07:00:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8bed9d640 1 -- 172.21.15.63:0/3736281259 learned_addr learned my addr 172.21.15.63:0/3736281259 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8bed9d640 1 -- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8c00ce1c0 msgr2=0x7fe8c00ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8be59c640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8c00ce1c0 0x7fe8c00ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8bed9d640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8c00ce1c0 0x7fe8c00ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8bf59e640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8c00ca7e0 0x7fe8c01f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:48.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8bed9d640 1 -- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8c00ca7e0 msgr2=0x7fe8c01f89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8bed9d640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8c00ca7e0 0x7fe8c01f89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8bed9d640 1 -- 172.21.15.63:0/3736281259 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c00ce5d0 con 0x7fe8ac0053d0 2024-09-21T07:00:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.224+0000 7fe8bed9d640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8ac0053d0 0x7fe8c0155c20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0011ab0 tx=0x7fe8b0011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.225+0000 7fe8b77fe640 1 -- 172.21.15.63:0/3736281259 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b001e070 con 0x7fe8ac0053d0 2024-09-21T07:00:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.225+0000 7fe8b77fe640 1 -- 172.21.15.63:0/3736281259 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8b000fc10 con 0x7fe8ac0053d0 2024-09-21T07:00:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.225+0000 7fe8b77fe640 1 -- 172.21.15.63:0/3736281259 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0019410 con 0x7fe8ac0053d0 2024-09-21T07:00:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.225+0000 7fe8c523f640 1 -- 172.21.15.63:0/3736281259 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c00cabf0 con 0x7fe8ac0053d0 2024-09-21T07:00:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.225+0000 7fe8c523f640 1 -- 172.21.15.63:0/3736281259 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c00b4700 con 0x7fe8ac0053d0 2024-09-21T07:00:48.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.226+0000 7fe8c523f640 1 -- 172.21.15.63:0/3736281259 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c00d0e70 con 0x7fe8ac0053d0 2024-09-21T07:00:48.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.227+0000 7fe8b77fe640 1 -- 172.21.15.63:0/3736281259 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8b0021070 con 0x7fe8ac0053d0 2024-09-21T07:00:48.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.227+0000 7fe8b77fe640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe8a0078b90 0x7fe8a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:48.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.227+0000 7fe8b77fe640 1 -- 172.21.15.63:0/3736281259 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe8b009b470 con 0x7fe8ac0053d0 2024-09-21T07:00:48.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.227+0000 7fe8be59c640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe8a0078b90 0x7fe8a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:48.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.228+0000 7fe8be59c640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe8a0078b90 0x7fe8a007b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00b7060 tx=0x7fe8a8006b70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:48.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.232+0000 7fe8b77fe640 1 -- 172.21.15.63:0/3736281259 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe8c00cabf0 con 0x7fe8ac0053d0 2024-09-21T07:00:48.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.420+0000 7fe8c523f640 1 -- 172.21.15.63:0/3736281259 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe8c00ce9d0 con 0x7fe8ac0053d0 2024-09-21T07:00:48.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.423+0000 7fe8b77fe640 1 -- 172.21.15.63:0/3736281259 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7fe8c00ce5d0 con 0x7fe8ac0053d0 2024-09-21T07:00:48.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.426+0000 7fe8c523f640 1 -- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe8a0078b90 msgr2=0x7fe8a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:48.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.426+0000 7fe8c523f640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe8a0078b90 0x7fe8a007b0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00b7060 tx=0x7fe8a8006b70 comp rx=0 tx=0).stop 2024-09-21T07:00:48.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.426+0000 7fe8c523f640 1 -- 172.21.15.63:0/3736281259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8ac0053d0 msgr2=0x7fe8c0155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:48.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.426+0000 7fe8c523f640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8ac0053d0 0x7fe8c0155c20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0011ab0 tx=0x7fe8b0011f70 comp rx=0 tx=0).stop 2024-09-21T07:00:48.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.426+0000 7fe8c523f640 1 -- 172.21.15.63:0/3736281259 shutdown_connections 2024-09-21T07:00:48.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.426+0000 7fe8c523f640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe8a0078b90 0x7fe8a007b0a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.426+0000 7fe8c523f640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe8c00ca7e0 0x7fe8c01f89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.426+0000 7fe8c523f640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe8c00ce1c0 0x7fe8c00ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.426+0000 7fe8c523f640 1 --2- 172.21.15.63:0/3736281259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe8ac0053d0 0x7fe8c0155c20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.426+0000 7fe8c523f640 1 -- 172.21.15.63:0/3736281259 >> 172.21.15.63:0/3736281259 conn(0x7fe8c00d45e0 msgr2=0x7fe8c00b7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:48.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.426+0000 7fe8c523f640 1 -- 172.21.15.63:0/3736281259 shutdown_connections 2024-09-21T07:00:48.428 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.426+0000 7fe8c523f640 1 -- 172.21.15.63:0/3736281259 wait complete. 2024-09-21T07:00:48.439 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:00:48.439 DEBUG:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:00:48.478 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:00:48.524 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:00:48.524 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:00:48.524 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:48.540 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:00:48.540 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:48.598 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:00:48.598 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:48.654 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:00:48.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.812+0000 7fbe29fa1640 1 -- 172.21.15.63:0/3729602666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe240b9aa0 msgr2=0x7fbe240d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:48.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.812+0000 7fbe29fa1640 1 --2- 172.21.15.63:0/3729602666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe240b9aa0 0x7fbe240d0bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c005fd0 tx=0x7fbe0c02a540 comp rx=0 tx=0).stop 2024-09-21T07:00:48.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.812+0000 7fbe29fa1640 1 -- 172.21.15.63:0/3729602666 shutdown_connections 2024-09-21T07:00:48.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.812+0000 7fbe29fa1640 1 --2- 172.21.15.63:0/3729602666 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe2408c960 0x7fbe240d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.812+0000 7fbe29fa1640 1 --2- 172.21.15.63:0/3729602666 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe240b9aa0 0x7fbe240d0bf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.812+0000 7fbe29fa1640 1 -- 172.21.15.63:0/3729602666 >> 172.21.15.63:0/3729602666 conn(0x7fbe240d45e0 msgr2=0x7fbe240d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:48.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.812+0000 7fbe29fa1640 1 -- 172.21.15.63:0/3729602666 shutdown_connections 2024-09-21T07:00:48.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.812+0000 7fbe29fa1640 1 -- 172.21.15.63:0/3729602666 wait complete. 2024-09-21T07:00:48.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.814+0000 7fbe29fa1640 1 Processor -- start 2024-09-21T07:00:48.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.814+0000 7fbe29fa1640 1 -- start start 2024-09-21T07:00:48.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.815+0000 7fbe29fa1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe2408c960 0x7fbe240ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:48.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe29fa1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe240b3aa0 0x7fbe240b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:48.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe29fa1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe240b9aa0 0x7fbe240b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe29fa1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2406ecc0 con 0x7fbe2408c960 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe29fa1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2406eb40 con 0x7fbe240b3aa0 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe29fa1640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fbe2406ee40 con 0x7fbe240b9aa0 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe237fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe2408c960 0x7fbe240ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe237fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe2408c960 0x7fbe240ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45424/0 (socket says 172.21.15.63:45424) 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe237fe640 1 -- 172.21.15.63:0/602391945 learned_addr learned my addr 172.21.15.63:0/602391945 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe1affd640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe240b3aa0 0x7fbe240b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe23fff640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe240b9aa0 0x7fbe240b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe237fe640 1 -- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe240b9aa0 msgr2=0x7fbe240b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe237fe640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe240b9aa0 0x7fbe240b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe237fe640 1 -- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe240b3aa0 msgr2=0x7fbe240b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe237fe640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe240b3aa0 0x7fbe240b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe237fe640 1 -- 172.21.15.63:0/602391945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe240ce5a0 con 0x7fbe2408c960 2024-09-21T07:00:48.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe237fe640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe2408c960 0x7fbe240ce060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400c390 tx=0x7fbe1400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:48.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.816+0000 7fbe20ff9640 1 -- 172.21.15.63:0/602391945 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14017070 con 0x7fbe2408c960 2024-09-21T07:00:48.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.817+0000 7fbe20ff9640 1 -- 172.21.15.63:0/602391945 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe140053c0 con 0x7fbe2408c960 2024-09-21T07:00:48.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.817+0000 7fbe20ff9640 1 -- 172.21.15.63:0/602391945 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14003880 con 0x7fbe2408c960 2024-09-21T07:00:48.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.817+0000 7fbe29fa1640 1 -- 172.21.15.63:0/602391945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2415ef50 con 0x7fbe2408c960 2024-09-21T07:00:48.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.817+0000 7fbe29fa1640 1 -- 172.21.15.63:0/602391945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe24161390 con 0x7fbe2408c960 2024-09-21T07:00:48.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.818+0000 7fbe29fa1640 1 -- 172.21.15.63:0/602391945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe2406f2f0 con 0x7fbe2408c960 2024-09-21T07:00:48.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.818+0000 7fbe20ff9640 1 -- 172.21.15.63:0/602391945 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe1401a070 con 0x7fbe2408c960 2024-09-21T07:00:48.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.819+0000 7fbe20ff9640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbe04078b90 0x7fbe0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:48.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.819+0000 7fbe20ff9640 1 -- 172.21.15.63:0/602391945 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbe1409a090 con 0x7fbe2408c960 2024-09-21T07:00:48.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.819+0000 7fbe1affd640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbe04078b90 0x7fbe0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:48.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.820+0000 7fbe1affd640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbe04078b90 0x7fbe0407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c033000 tx=0x7fbe0c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:48.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:48.823+0000 7fbe20ff9640 1 -- 172.21.15.63:0/602391945 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fbe240ce5a0 con 0x7fbe2408c960 2024-09-21T07:00:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.021+0000 7fbe29fa1640 1 -- 172.21.15.63:0/602391945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbe240d1890 con 0x7fbe2408c960 2024-09-21T07:00:49.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.022+0000 7fbe20ff9640 1 -- 172.21.15.63:0/602391945 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fbe14061f10 con 0x7fbe2408c960 2024-09-21T07:00:49.024 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-21T07:00:49.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.024+0000 7fbe29fa1640 1 -- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbe04078b90 msgr2=0x7fbe0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:49.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.024+0000 7fbe29fa1640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbe04078b90 0x7fbe0407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c033000 tx=0x7fbe0c004730 comp rx=0 tx=0).stop 2024-09-21T07:00:49.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.024+0000 7fbe29fa1640 1 -- 172.21.15.63:0/602391945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe2408c960 msgr2=0x7fbe240ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:49.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.024+0000 7fbe29fa1640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe2408c960 0x7fbe240ce060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400c390 tx=0x7fbe1400c850 comp rx=0 tx=0).stop 2024-09-21T07:00:49.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.024+0000 7fbe29fa1640 1 -- 172.21.15.63:0/602391945 shutdown_connections 2024-09-21T07:00:49.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.024+0000 7fbe29fa1640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fbe04078b90 0x7fbe0407b0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:49.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.024+0000 7fbe29fa1640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fbe240b9aa0 0x7fbe240b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:49.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.024+0000 7fbe29fa1640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe240b3aa0 0x7fbe240b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:49.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.024+0000 7fbe29fa1640 1 --2- 172.21.15.63:0/602391945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe2408c960 0x7fbe240ce060 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:49.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.024+0000 7fbe29fa1640 1 -- 172.21.15.63:0/602391945 >> 172.21.15.63:0/602391945 conn(0x7fbe240d45e0 msgr2=0x7fbe240d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:49.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.024+0000 7fbe29fa1640 1 -- 172.21.15.63:0/602391945 shutdown_connections 2024-09-21T07:00:49.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.024+0000 7fbe29fa1640 1 -- 172.21.15.63:0/602391945 wait complete. 2024-09-21T07:00:49.037 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:00:49.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:49.037 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-21T07:00:49.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T07:00:49.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:49.064 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:00:49.129 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T07:00:49.130 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:49.149 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T07:00:49.149 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:49.207 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T07:00:49.207 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:49.264 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:00:49.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.380+0000 7f02b1fc3640 1 -- 172.21.15.63:0/167453467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02ac070640 msgr2=0x7f02ac0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.380+0000 7f02b1fc3640 1 --2- 172.21.15.63:0/167453467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02ac070640 0x7f02ac0b4c70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0b31d0 tx=0x7f029c02a560 comp rx=0 tx=0).stop 2024-09-21T07:00:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.380+0000 7f02b1fc3640 1 -- 172.21.15.63:0/167453467 shutdown_connections 2024-09-21T07:00:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.380+0000 7f02b1fc3640 1 --2- 172.21.15.63:0/167453467 >> v2:172.21.15.71:3300/0 conn(0x7f02ac15bbe0 0x7f02ac15e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.380+0000 7f02b1fc3640 1 --2- 172.21.15.63:0/167453467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02ac070640 0x7f02ac0b4c70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.380+0000 7f02b1fc3640 1 -- 172.21.15.63:0/167453467 >> 172.21.15.63:0/167453467 conn(0x7f02ac06d3e0 msgr2=0x7f02ac0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.381+0000 7f02b1fc3640 1 -- 172.21.15.63:0/167453467 shutdown_connections 2024-09-21T07:00:49.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.381+0000 7f02b1fc3640 1 -- 172.21.15.63:0/167453467 wait complete. 2024-09-21T07:00:49.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.382+0000 7f02b1fc3640 1 Processor -- start 2024-09-21T07:00:49.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.382+0000 7f02b1fc3640 1 -- start start 2024-09-21T07:00:49.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02b1fc3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02ac070640 0x7f02ac15e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:49.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02b1fc3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f02ac070b50 0x7f02ac15ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:49.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02b1fc3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02ac15bbe0 0x7f02ac09cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:49.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02b1fc3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac0b2460 con 0x7f02ac15bbe0 2024-09-21T07:00:49.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02b1fc3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac15c200 con 0x7f02ac070640 2024-09-21T07:00:49.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02b1fc3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f02ac0b25e0 con 0x7f02ac070b50 2024-09-21T07:00:49.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02abfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02ac15bbe0 0x7f02ac09cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:49.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02abfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02ac15bbe0 0x7f02ac09cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45438/0 (socket says 172.21.15.63:45438) 2024-09-21T07:00:49.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02abfff640 1 -- 172.21.15.63:0/2281360309 learned_addr learned my addr 172.21.15.63:0/2281360309 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:49.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02ab7fe640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02ac070640 0x7f02ac15e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:49.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02aaffd640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f02ac070b50 0x7f02ac15ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:49.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02abfff640 1 -- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f02ac070b50 msgr2=0x7f02ac15ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:49.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02abfff640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f02ac070b50 0x7f02ac15ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:49.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02abfff640 1 -- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02ac070640 msgr2=0x7f02ac15e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:49.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02abfff640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02ac070640 0x7f02ac15e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:49.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02abfff640 1 -- 172.21.15.63:0/2281360309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ac0b0930 con 0x7f02ac15bbe0 2024-09-21T07:00:49.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.384+0000 7f02abfff640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02ac15bbe0 0x7f02ac09cd60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f02a400ea40 tx=0x7f02a400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:49.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.385+0000 7f0293fff640 1 -- 172.21.15.63:0/2281360309 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a400ce40 con 0x7f02ac15bbe0 2024-09-21T07:00:49.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.385+0000 7f0293fff640 1 -- 172.21.15.63:0/2281360309 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02a4004c10 con 0x7f02ac15bbe0 2024-09-21T07:00:49.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.385+0000 7f02b1fc3640 1 -- 172.21.15.63:0/2281360309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02ac09bcc0 con 0x7f02ac15bbe0 2024-09-21T07:00:49.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.385+0000 7f0293fff640 1 -- 172.21.15.63:0/2281360309 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a4005020 con 0x7f02ac15bbe0 2024-09-21T07:00:49.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.385+0000 7f02b1fc3640 1 -- 172.21.15.63:0/2281360309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02ac09c280 con 0x7f02ac15bbe0 2024-09-21T07:00:49.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.386+0000 7f02b1fc3640 1 -- 172.21.15.63:0/2281360309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02ac0b4c70 con 0x7f02ac15bbe0 2024-09-21T07:00:49.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.386+0000 7f0293fff640 1 -- 172.21.15.63:0/2281360309 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f02a40051c0 con 0x7f02ac15bbe0 2024-09-21T07:00:49.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.387+0000 7f0293fff640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0298078b90 0x7f029807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:49.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.387+0000 7f0293fff640 1 -- 172.21.15.63:0/2281360309 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f02a409bac0 con 0x7f02ac15bbe0 2024-09-21T07:00:49.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.387+0000 7f02ab7fe640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0298078b90 0x7f029807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:49.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.388+0000 7f02ab7fe640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0298078b90 0x7f029807b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f029c033000 tx=0x7f029c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:49.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.391+0000 7f0293fff640 1 -- 172.21.15.63:0/2281360309 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f02a4063f00 con 0x7f02ac15bbe0 2024-09-21T07:00:49.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.592+0000 7f02b1fc3640 1 -- 172.21.15.63:0/2281360309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f02ac06fdf0 con 0x7f02ac15bbe0 2024-09-21T07:00:49.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.593+0000 7f0293fff640 1 -- 172.21.15.63:0/2281360309 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f02a4063800 con 0x7f02ac15bbe0 2024-09-21T07:00:49.594 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-21T07:00:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.595+0000 7f02b1fc3640 1 -- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0298078b90 msgr2=0x7f029807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.595+0000 7f02b1fc3640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0298078b90 0x7f029807b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f029c033000 tx=0x7f029c004730 comp rx=0 tx=0).stop 2024-09-21T07:00:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.595+0000 7f02b1fc3640 1 -- 172.21.15.63:0/2281360309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02ac15bbe0 msgr2=0x7f02ac09cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.595+0000 7f02b1fc3640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02ac15bbe0 0x7f02ac09cd60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f02a400ea40 tx=0x7f02a400ef00 comp rx=0 tx=0).stop 2024-09-21T07:00:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.595+0000 7f02b1fc3640 1 -- 172.21.15.63:0/2281360309 shutdown_connections 2024-09-21T07:00:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.595+0000 7f02b1fc3640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0298078b90 0x7f029807b0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.595+0000 7f02b1fc3640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02ac15bbe0 0x7f02ac09cd60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.595+0000 7f02b1fc3640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f02ac070b50 0x7f02ac15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.595+0000 7f02b1fc3640 1 --2- 172.21.15.63:0/2281360309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02ac070640 0x7f02ac15e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.595+0000 7f02b1fc3640 1 -- 172.21.15.63:0/2281360309 >> 172.21.15.63:0/2281360309 conn(0x7f02ac06d3e0 msgr2=0x7f02ac1534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:49.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.595+0000 7f02b1fc3640 1 -- 172.21.15.63:0/2281360309 shutdown_connections 2024-09-21T07:00:49.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:49.595+0000 7f02b1fc3640 1 -- 172.21.15.63:0/2281360309 wait complete. 2024-09-21T07:00:49.608 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-21T07:00:49.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:49.608 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-21T07:00:49.640 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T07:00:49.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:49.640 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-21T07:00:49.969 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:00:49.969 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:49.986 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:00:49.987 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:50.043 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:00:50.043 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:50.100 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:00:50.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.257+0000 7fd02bc9b640 1 -- 172.21.15.63:0/270048349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0240b6ca0 msgr2=0x7fd0240b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:50.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.257+0000 7fd02bc9b640 1 --2- 172.21.15.63:0/270048349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0240b6ca0 0x7fd0240b6730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd020009830 tx=0x7fd02002a510 comp rx=0 tx=0).stop 2024-09-21T07:00:50.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.258+0000 7fd02bc9b640 1 -- 172.21.15.63:0/270048349 shutdown_connections 2024-09-21T07:00:50.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.258+0000 7fd02bc9b640 1 --2- 172.21.15.63:0/270048349 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd0240d0af0 0x7fd0240ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:50.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.258+0000 7fd02bc9b640 1 --2- 172.21.15.63:0/270048349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0240b6ca0 0x7fd0240b6730 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:50.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.258+0000 7fd02bc9b640 1 -- 172.21.15.63:0/270048349 >> 172.21.15.63:0/270048349 conn(0x7fd0240b2f70 msgr2=0x7fd0240b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:50.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.258+0000 7fd02bc9b640 1 -- 172.21.15.63:0/270048349 shutdown_connections 2024-09-21T07:00:50.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.258+0000 7fd02bc9b640 1 -- 172.21.15.63:0/270048349 wait complete. 2024-09-21T07:00:50.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.259+0000 7fd02bc9b640 1 Processor -- start 2024-09-21T07:00:50.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.259+0000 7fd02bc9b640 1 -- start start 2024-09-21T07:00:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd02bc9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0240b6ca0 0x7fd0240cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd02bc9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0240d0af0 0x7fd0240cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd02bc9b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd02415c9a0 0x7fd0240c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd02bc9b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd0240aeb20 con 0x7fd0240d0af0 2024-09-21T07:00:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd02bc9b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd0240ae9a0 con 0x7fd0240b6ca0 2024-09-21T07:00:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd02bc9b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd0240aeca0 con 0x7fd02415c9a0 2024-09-21T07:00:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd029236640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0240d0af0 0x7fd0240cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd029236640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0240d0af0 0x7fd0240cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45444/0 (socket says 172.21.15.63:45444) 2024-09-21T07:00:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd029236640 1 -- 172.21.15.63:0/4292339766 learned_addr learned my addr 172.21.15.63:0/4292339766 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd029a37640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0240b6ca0 0x7fd0240cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd02a238640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd02415c9a0 0x7fd0240c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd029236640 1 -- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd02415c9a0 msgr2=0x7fd0240c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd029236640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd02415c9a0 0x7fd0240c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd029236640 1 -- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0240b6ca0 msgr2=0x7fd0240cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd029236640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0240b6ca0 0x7fd0240cd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd029236640 1 -- 172.21.15.63:0/4292339766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0240cbaa0 con 0x7fd0240d0af0 2024-09-21T07:00:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.261+0000 7fd029236640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0240d0af0 0x7fd0240cdd30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd01800c760 tx=0x7fd01800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.262+0000 7fd0167fc640 1 -- 172.21.15.63:0/4292339766 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd018016020 con 0x7fd0240d0af0 2024-09-21T07:00:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.262+0000 7fd0167fc640 1 -- 172.21.15.63:0/4292339766 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd01800a950 con 0x7fd0240d0af0 2024-09-21T07:00:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.262+0000 7fd02bc9b640 1 -- 172.21.15.63:0/4292339766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0240cbd80 con 0x7fd0240d0af0 2024-09-21T07:00:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.262+0000 7fd0167fc640 1 -- 172.21.15.63:0/4292339766 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01800ada0 con 0x7fd0240d0af0 2024-09-21T07:00:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.262+0000 7fd02bc9b640 1 -- 172.21.15.63:0/4292339766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0240cc340 con 0x7fd0240d0af0 2024-09-21T07:00:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.263+0000 7fd02bc9b640 1 -- 172.21.15.63:0/4292339766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0240af1c0 con 0x7fd0240d0af0 2024-09-21T07:00:50.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.264+0000 7fd0167fc640 1 -- 172.21.15.63:0/4292339766 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd018019020 con 0x7fd0240d0af0 2024-09-21T07:00:50.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.264+0000 7fd0167fc640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd008078b90 0x7fd00807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:50.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.265+0000 7fd0167fc640 1 -- 172.21.15.63:0/4292339766 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd01809b040 con 0x7fd0240d0af0 2024-09-21T07:00:50.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.265+0000 7fd029a37640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd008078b90 0x7fd00807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:50.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.265+0000 7fd029a37640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd008078b90 0x7fd00807b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd020034000 tx=0x7fd020004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:50.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.268+0000 7fd0167fc640 1 -- 172.21.15.63:0/4292339766 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd018020020 con 0x7fd0240d0af0 2024-09-21T07:00:50.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.466+0000 7fd02bc9b640 1 -- 172.21.15.63:0/4292339766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd024158d00 con 0x7fd0240d0af0 2024-09-21T07:00:50.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.466+0000 7fd0167fc640 1 -- 172.21.15.63:0/4292339766 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fd0240b3e30 con 0x7fd0240d0af0 2024-09-21T07:00:50.468 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-21T07:00:50.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.468+0000 7fd02bc9b640 1 -- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd008078b90 msgr2=0x7fd00807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.468+0000 7fd02bc9b640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd008078b90 0x7fd00807b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd020034000 tx=0x7fd020004730 comp rx=0 tx=0).stop 2024-09-21T07:00:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.468+0000 7fd02bc9b640 1 -- 172.21.15.63:0/4292339766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0240d0af0 msgr2=0x7fd0240cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.468+0000 7fd02bc9b640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0240d0af0 0x7fd0240cdd30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd01800c760 tx=0x7fd01800cc20 comp rx=0 tx=0).stop 2024-09-21T07:00:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.469+0000 7fd02bc9b640 1 -- 172.21.15.63:0/4292339766 shutdown_connections 2024-09-21T07:00:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.469+0000 7fd02bc9b640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd008078b90 0x7fd00807b0a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.469+0000 7fd02bc9b640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd02415c9a0 0x7fd0240c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.469+0000 7fd02bc9b640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd0240d0af0 0x7fd0240cdd30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.469+0000 7fd02bc9b640 1 --2- 172.21.15.63:0/4292339766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd0240b6ca0 0x7fd0240cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.469+0000 7fd02bc9b640 1 -- 172.21.15.63:0/4292339766 >> 172.21.15.63:0/4292339766 conn(0x7fd0240b2f70 msgr2=0x7fd024071670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.469+0000 7fd02bc9b640 1 -- 172.21.15.63:0/4292339766 shutdown_connections 2024-09-21T07:00:50.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.469+0000 7fd02bc9b640 1 -- 172.21.15.63:0/4292339766 wait complete. 2024-09-21T07:00:50.482 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-21T07:00:50.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:50.482 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-21T07:00:50.508 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T07:00:50.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:50.508 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-21T07:00:50.565 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T07:00:50.565 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:50.584 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T07:00:50.584 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:50.642 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T07:00:50.642 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:00:50.700 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:00:50.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.816+0000 7f780a2a9640 1 -- 172.21.15.63:0/3034756792 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f78040cf240 msgr2=0x7f78040cf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:50.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.816+0000 7f780a2a9640 1 --2- 172.21.15.63:0/3034756792 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f78040cf240 0x7f78040cf650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f77f8005fd0 tx=0x7f77f802a540 comp rx=0 tx=0).stop 2024-09-21T07:00:50.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.816+0000 7f780a2a9640 1 -- 172.21.15.63:0/3034756792 shutdown_connections 2024-09-21T07:00:50.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.816+0000 7f780a2a9640 1 --2- 172.21.15.63:0/3034756792 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f78040cf240 0x7f78040cf650 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:50.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.816+0000 7f780a2a9640 1 --2- 172.21.15.63:0/3034756792 >> v2:172.21.15.71:3300/0 conn(0x7f78040b7460 0x7f78041620d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:50.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.816+0000 7f780a2a9640 1 -- 172.21.15.63:0/3034756792 >> 172.21.15.63:0/3034756792 conn(0x7f78040d4610 msgr2=0x7f78040d4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:50.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.816+0000 7f780a2a9640 1 -- 172.21.15.63:0/3034756792 shutdown_connections 2024-09-21T07:00:50.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.816+0000 7f780a2a9640 1 -- 172.21.15.63:0/3034756792 wait complete. 2024-09-21T07:00:50.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.818+0000 7f780a2a9640 1 Processor -- start 2024-09-21T07:00:50.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.818+0000 7f780a2a9640 1 -- start start 2024-09-21T07:00:50.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.819+0000 7f780a2a9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f78040b7460 0x7f78040b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:50.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.819+0000 7f780a2a9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78040cf240 0x7f78040b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.819+0000 7f780a2a9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78040cfb90 0x7f78040b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.819+0000 7f780a2a9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f78040b2fb0 con 0x7f78040cfb90 2024-09-21T07:00:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.819+0000 7f780a2a9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f78040b2e30 con 0x7f78040cf240 2024-09-21T07:00:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.819+0000 7f780a2a9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f78040b3130 con 0x7f78040b7460 2024-09-21T07:00:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.819+0000 7f7808846640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78040cfb90 0x7f78040b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.819+0000 7f7808846640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78040cfb90 0x7f78040b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45460/0 (socket says 172.21.15.63:45460) 2024-09-21T07:00:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.819+0000 7f7808846640 1 -- 172.21.15.63:0/721360092 learned_addr learned my addr 172.21.15.63:0/721360092 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.819+0000 7f7803fff640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f78040b7460 0x7f78040b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.819+0000 7f78037fe640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78040cf240 0x7f78040b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.820+0000 7f7808846640 1 -- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f78040b7460 msgr2=0x7f78040b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.820+0000 7f7808846640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f78040b7460 0x7f78040b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.820+0000 7f7808846640 1 -- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78040cf240 msgr2=0x7f78040b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.820+0000 7f7808846640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78040cf240 0x7f78040b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.820+0000 7f7808846640 1 -- 172.21.15.63:0/721360092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78041591a0 con 0x7f78040cfb90 2024-09-21T07:00:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.820+0000 7f7808846640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78040cfb90 0x7f78040b5090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00c6b0 tx=0x7f77fc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.820+0000 7f7800ff9640 1 -- 172.21.15.63:0/721360092 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc003b70 con 0x7f78040cfb90 2024-09-21T07:00:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.820+0000 7f7800ff9640 1 -- 172.21.15.63:0/721360092 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77fc003d30 con 0x7f78040cfb90 2024-09-21T07:00:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.820+0000 7f780a2a9640 1 -- 172.21.15.63:0/721360092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7804159480 con 0x7f78040cfb90 2024-09-21T07:00:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.820+0000 7f7800ff9640 1 -- 172.21.15.63:0/721360092 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc005330 con 0x7f78040cfb90 2024-09-21T07:00:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.820+0000 7f780a2a9640 1 -- 172.21.15.63:0/721360092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7804159a40 con 0x7f78040cfb90 2024-09-21T07:00:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.821+0000 7f780a2a9640 1 -- 172.21.15.63:0/721360092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7804158f10 con 0x7f78040cfb90 2024-09-21T07:00:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.822+0000 7f7800ff9640 1 -- 172.21.15.63:0/721360092 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f77fc0054d0 con 0x7f78040cfb90 2024-09-21T07:00:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.822+0000 7f7800ff9640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f77f0078b90 0x7f77f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.822+0000 7f7800ff9640 1 -- 172.21.15.63:0/721360092 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f77fc09a8d0 con 0x7f78040cfb90 2024-09-21T07:00:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.823+0000 7f7803fff640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f77f0078b90 0x7f77f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:50.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.823+0000 7f7803fff640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f77f0078b90 0x7f77f007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009590 tx=0x7f77f4005f30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:50.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:50.827+0000 7f7800ff9640 1 -- 172.21.15.63:0/721360092 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f77fc062750 con 0x7f78040cfb90 2024-09-21T07:00:51.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.024+0000 7f780a2a9640 1 -- 172.21.15.63:0/721360092 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f78040d4bc0 con 0x7f78040cfb90 2024-09-21T07:00:51.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.024+0000 7f7800ff9640 1 -- 172.21.15.63:0/721360092 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f77fc067180 con 0x7f78040cfb90 2024-09-21T07:00:51.026 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-09-21T07:00:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.027+0000 7f780a2a9640 1 -- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f77f0078b90 msgr2=0x7f77f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.027+0000 7f780a2a9640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f77f0078b90 0x7f77f007b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009590 tx=0x7f77f4005f30 comp rx=0 tx=0).stop 2024-09-21T07:00:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.027+0000 7f780a2a9640 1 -- 172.21.15.63:0/721360092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78040cfb90 msgr2=0x7f78040b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.027+0000 7f780a2a9640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78040cfb90 0x7f78040b5090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00c6b0 tx=0x7f77fc00cb70 comp rx=0 tx=0).stop 2024-09-21T07:00:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.027+0000 7f780a2a9640 1 -- 172.21.15.63:0/721360092 shutdown_connections 2024-09-21T07:00:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.027+0000 7f780a2a9640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f77f0078b90 0x7f77f007b0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.027+0000 7f780a2a9640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f78040cfb90 0x7f78040b5090 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.027+0000 7f780a2a9640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78040cf240 0x7f78040b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.027+0000 7f780a2a9640 1 --2- 172.21.15.63:0/721360092 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f78040b7460 0x7f78040b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.027+0000 7f780a2a9640 1 -- 172.21.15.63:0/721360092 >> 172.21.15.63:0/721360092 conn(0x7f78040d4610 msgr2=0x7f78040d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.027+0000 7f780a2a9640 1 -- 172.21.15.63:0/721360092 shutdown_connections 2024-09-21T07:00:51.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.027+0000 7f780a2a9640 1 -- 172.21.15.63:0/721360092 wait complete. 2024-09-21T07:00:51.040 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-21T07:00:51.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:51.040 DEBUG:teuthology.orchestra.run.smithi071:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-21T07:00:51.071 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T07:00:51.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:00:51.072 DEBUG:teuthology.orchestra.run.smithi071:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-21T07:00:51.130 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-21T07:00:51.130 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:00:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.245+0000 7ff12beb2640 1 -- 172.21.15.63:0/420939191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff110004800 msgr2=0x7ff110004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.245+0000 7ff12beb2640 1 --2- 172.21.15.63:0/420939191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff110004800 0x7ff110004c10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff12406a9c0 tx=0x7ff110005830 comp rx=0 tx=0).stop 2024-09-21T07:00:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.246+0000 7ff12beb2640 1 -- 172.21.15.63:0/420939191 shutdown_connections 2024-09-21T07:00:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.246+0000 7ff12beb2640 1 --2- 172.21.15.63:0/420939191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff110004800 0x7ff110004c10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.246+0000 7ff12beb2640 1 -- 172.21.15.63:0/420939191 >> 172.21.15.63:0/420939191 conn(0x7ff1240ceed0 msgr2=0x7ff1240cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.246+0000 7ff12beb2640 1 -- 172.21.15.63:0/420939191 shutdown_connections 2024-09-21T07:00:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.246+0000 7ff12beb2640 1 -- 172.21.15.63:0/420939191 wait complete. 2024-09-21T07:00:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.247+0000 7ff12beb2640 1 Processor -- start 2024-09-21T07:00:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.247+0000 7ff12beb2640 1 -- start start 2024-09-21T07:00:51.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff12beb2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff110004800 0x7ff1240af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff12beb2640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff124156df0 0x7ff12415ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff12beb2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff12415a2a0 0x7ff12415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff12beb2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff1240d0760 con 0x7ff110004800 2024-09-21T07:00:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff12beb2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1240d1400 con 0x7ff12415a2a0 2024-09-21T07:00:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff12beb2640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff1240b8280 con 0x7ff124156df0 2024-09-21T07:00:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff129c4e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff110004800 0x7ff1240af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff129c4e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff110004800 0x7ff1240af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45468/0 (socket says 172.21.15.63:45468) 2024-09-21T07:00:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff129c4e640 1 -- 172.21.15.63:0/1612404553 learned_addr learned my addr 172.21.15.63:0/1612404553 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff12a44f640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff12415a2a0 0x7ff12415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff12944d640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff124156df0 0x7ff12415ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff129c4e640 1 -- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff124156df0 msgr2=0x7ff12415ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff129c4e640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff124156df0 0x7ff12415ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff129c4e640 1 -- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff12415a2a0 msgr2=0x7ff12415a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff129c4e640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff12415a2a0 0x7ff12415a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff129c4e640 1 -- 172.21.15.63:0/1612404553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1241597e0 con 0x7ff110004800 2024-09-21T07:00:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.249+0000 7ff129c4e640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff110004800 0x7ff1240af4d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff1200063d0 tx=0x7ff1200039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.250+0000 7ff11a7fc640 1 -- 172.21.15.63:0/1612404553 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120015070 con 0x7ff110004800 2024-09-21T07:00:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.250+0000 7ff11a7fc640 1 -- 172.21.15.63:0/1612404553 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff120011860 con 0x7ff110004800 2024-09-21T07:00:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.250+0000 7ff12beb2640 1 -- 172.21.15.63:0/1612404553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12415f420 con 0x7ff110004800 2024-09-21T07:00:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.250+0000 7ff11a7fc640 1 -- 172.21.15.63:0/1612404553 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120011cb0 con 0x7ff110004800 2024-09-21T07:00:51.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.250+0000 7ff12beb2640 1 -- 172.21.15.63:0/1612404553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff124159aa0 con 0x7ff110004800 2024-09-21T07:00:51.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.251+0000 7ff12beb2640 1 -- 172.21.15.63:0/1612404553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1240d0cf0 con 0x7ff110004800 2024-09-21T07:00:51.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.252+0000 7ff11a7fc640 1 -- 172.21.15.63:0/1612404553 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff120018070 con 0x7ff110004800 2024-09-21T07:00:51.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.252+0000 7ff11a7fc640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff108078bc0 0x7ff10807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:51.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.252+0000 7ff11a7fc640 1 -- 172.21.15.63:0/1612404553 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff12009b810 con 0x7ff110004800 2024-09-21T07:00:51.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.252+0000 7ff12944d640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff108078bc0 0x7ff10807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:51.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.253+0000 7ff12944d640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff108078bc0 0x7ff10807b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff114032000 tx=0x7ff11402c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:51.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.257+0000 7ff11a7fc640 1 -- 172.21.15.63:0/1612404553 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff120063720 con 0x7ff110004800 2024-09-21T07:00:51.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.483+0000 7ff12beb2640 1 -- 172.21.15.63:0/1612404553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1241608d0 con 0x7ff110004800 2024-09-21T07:00:51.486 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.484+0000 7ff11a7fc640 1 -- 172.21.15.63:0/1612404553 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5208 (secure 0 0 0) 0x7ff120068150 con 0x7ff110004800 2024-09-21T07:00:51.486 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:51.486 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-21T07:00:24:568573+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/4041704430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":4041704430},{"type":"v1","addr":"172.21.15.63:6834","nonce":4041704430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1032053510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":1032053510},{"type":"v1","addr":"172.21.15.63:6835","nonce":1032053510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/18747791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":18747791},{"type":"v1","addr":"172.21.15.71:6836","nonce":18747791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:00:20.923025+0000","modified":"2024-09-21T07:00:23.948505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/767391345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":767391345},{"type":"v1","addr":"172.21.15.71:6837","nonce":767391345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T07:00:51.486 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-21T07:00:51.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.486+0000 7ff12beb2640 1 -- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff108078bc0 msgr2=0x7ff10807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.486+0000 7ff12beb2640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff108078bc0 0x7ff10807b0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff114032000 tx=0x7ff11402c040 comp rx=0 tx=0).stop 2024-09-21T07:00:51.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.486+0000 7ff12beb2640 1 -- 172.21.15.63:0/1612404553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff110004800 msgr2=0x7ff1240af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.486+0000 7ff12beb2640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff110004800 0x7ff1240af4d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff1200063d0 tx=0x7ff1200039c0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.487+0000 7ff12beb2640 1 -- 172.21.15.63:0/1612404553 shutdown_connections 2024-09-21T07:00:51.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.487+0000 7ff12beb2640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff108078bc0 0x7ff10807b0d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.487+0000 7ff12beb2640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff12415a2a0 0x7ff12415a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.487+0000 7ff12beb2640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff124156df0 0x7ff12415ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.487+0000 7ff12beb2640 1 --2- 172.21.15.63:0/1612404553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff110004800 0x7ff1240af4d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.487+0000 7ff12beb2640 1 -- 172.21.15.63:0/1612404553 >> 172.21.15.63:0/1612404553 conn(0x7ff1240ceed0 msgr2=0x7ff1240724f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:51.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.487+0000 7ff12beb2640 1 -- 172.21.15.63:0/1612404553 shutdown_connections 2024-09-21T07:00:51.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.487+0000 7ff12beb2640 1 -- 172.21.15.63:0/1612404553 wait complete. 2024-09-21T07:00:51.500 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:00:51.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.615+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2445520348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b940cf310 msgr2=0x7f4b940cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.615+0000 7f4b99d0b640 1 --2- 172.21.15.63:0/2445520348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b940cf310 0x7f4b940cf720 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c005fd0 tx=0x7f4b8c02a8b0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.615+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2445520348 shutdown_connections 2024-09-21T07:00:51.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.615+0000 7f4b99d0b640 1 --2- 172.21.15.63:0/2445520348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b940cf310 0x7f4b940cf720 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.615+0000 7f4b99d0b640 1 --2- 172.21.15.63:0/2445520348 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b940b7530 0x7f4b940d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.615+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2445520348 >> 172.21.15.63:0/2445520348 conn(0x7f4b9408bfd0 msgr2=0x7f4b940d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:51.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.615+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2445520348 shutdown_connections 2024-09-21T07:00:51.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.615+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2445520348 wait complete. 2024-09-21T07:00:51.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.617+0000 7f4b99d0b640 1 Processor -- start 2024-09-21T07:00:51.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.617+0000 7f4b99d0b640 1 -- start start 2024-09-21T07:00:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.618+0000 7f4b99d0b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b940b7530 0x7f4b940c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.618+0000 7f4b99d0b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b940cf310 0x7f4b941f93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:51.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.618+0000 7f4b99d0b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b9415ef00 0x7f4b941f9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.618+0000 7f4b99d0b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4b940cfff0 con 0x7f4b940b7530 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.618+0000 7f4b99d0b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b940cfe70 con 0x7f4b940cf310 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.618+0000 7f4b99d0b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4b940d0170 con 0x7f4b9415ef00 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.618+0000 7f4b937fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b940b7530 0x7f4b940c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.618+0000 7f4b937fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b940b7530 0x7f4b940c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45476/0 (socket says 172.21.15.63:45476) 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.618+0000 7f4b937fe640 1 -- 172.21.15.63:0/2043154285 learned_addr learned my addr 172.21.15.63:0/2043154285 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.618+0000 7f4b93fff640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b9415ef00 0x7f4b941f9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.618+0000 7f4b92ffd640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b940cf310 0x7f4b941f93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.619+0000 7f4b937fe640 1 -- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b9415ef00 msgr2=0x7f4b941f9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.619+0000 7f4b937fe640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b9415ef00 0x7f4b941f9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.619+0000 7f4b937fe640 1 -- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b940cf310 msgr2=0x7f4b941f93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.619+0000 7f4b937fe640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b940cf310 0x7f4b941f93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.619+0000 7f4b937fe640 1 -- 172.21.15.63:0/2043154285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b940c8960 con 0x7f4b940b7530 2024-09-21T07:00:51.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.619+0000 7f4b92ffd640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b940cf310 0x7f4b941f93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:51.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.619+0000 7f4b937fe640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b940b7530 0x7f4b940c8420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400c9d0 tx=0x7f4b8400ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:51.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.619+0000 7f4b7bfff640 1 -- 172.21.15.63:0/2043154285 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b84007c70 con 0x7f4b940b7530 2024-09-21T07:00:51.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.619+0000 7f4b7bfff640 1 -- 172.21.15.63:0/2043154285 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b84005020 con 0x7f4b940b7530 2024-09-21T07:00:51.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.619+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2043154285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b941614a0 con 0x7f4b940b7530 2024-09-21T07:00:51.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.619+0000 7f4b7bfff640 1 -- 172.21.15.63:0/2043154285 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b84005470 con 0x7f4b940b7530 2024-09-21T07:00:51.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.619+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2043154285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b94161a60 con 0x7f4b940b7530 2024-09-21T07:00:51.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.620+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2043154285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b940d0730 con 0x7f4b940b7530 2024-09-21T07:00:51.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.621+0000 7f4b7bfff640 1 -- 172.21.15.63:0/2043154285 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4b840047e0 con 0x7f4b940b7530 2024-09-21T07:00:51.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.621+0000 7f4b7bfff640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4b80078bc0 0x7f4b8007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:51.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.622+0000 7f4b7bfff640 1 -- 172.21.15.63:0/2043154285 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4b8409aca0 con 0x7f4b940b7530 2024-09-21T07:00:51.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.622+0000 7f4b92ffd640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4b80078bc0 0x7f4b8007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:51.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.622+0000 7f4b92ffd640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4b80078bc0 0x7f4b8007b0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4b940b3990 tx=0x7f4b88009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:51.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.626+0000 7f4b7bfff640 1 -- 172.21.15.63:0/2043154285 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4b940c8960 con 0x7f4b940b7530 2024-09-21T07:00:51.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.855+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2043154285 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b9406a130 con 0x7f4b940b7530 2024-09-21T07:00:51.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.856+0000 7f4b7bfff640 1 -- 172.21.15.63:0/2043154285 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5208 (secure 0 0 0) 0x7f4b84014030 con 0x7f4b940b7530 2024-09-21T07:00:51.858 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:51.858 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-21T07:00:24:568573+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/4041704430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":4041704430},{"type":"v1","addr":"172.21.15.63:6834","nonce":4041704430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1032053510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":1032053510},{"type":"v1","addr":"172.21.15.63:6835","nonce":1032053510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/18747791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":18747791},{"type":"v1","addr":"172.21.15.71:6836","nonce":18747791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:00:20.923025+0000","modified":"2024-09-21T07:00:23.948505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/767391345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":767391345},{"type":"v1","addr":"172.21.15.71:6837","nonce":767391345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T07:00:51.858 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-21T07:00:51.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.858+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4b80078bc0 msgr2=0x7f4b8007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.858+0000 7f4b99d0b640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4b80078bc0 0x7f4b8007b0d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4b940b3990 tx=0x7f4b88009040 comp rx=0 tx=0).stop 2024-09-21T07:00:51.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.858+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2043154285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b940b7530 msgr2=0x7f4b940c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.858+0000 7f4b99d0b640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b940b7530 0x7f4b940c8420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400c9d0 tx=0x7f4b8400ce90 comp rx=0 tx=0).stop 2024-09-21T07:00:51.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.858+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2043154285 shutdown_connections 2024-09-21T07:00:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.858+0000 7f4b99d0b640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4b80078bc0 0x7f4b8007b0d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.858+0000 7f4b99d0b640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4b9415ef00 0x7f4b941f9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.858+0000 7f4b99d0b640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b940cf310 0x7f4b941f93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.858+0000 7f4b99d0b640 1 --2- 172.21.15.63:0/2043154285 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b940b7530 0x7f4b940c8420 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.858+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2043154285 >> 172.21.15.63:0/2043154285 conn(0x7f4b9408bfd0 msgr2=0x7f4b940b9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.858+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2043154285 shutdown_connections 2024-09-21T07:00:51.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.858+0000 7f4b99d0b640 1 -- 172.21.15.63:0/2043154285 wait complete. 2024-09-21T07:00:51.872 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:00:51.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.986+0000 7f0ea3070640 1 -- 172.21.15.63:0/2123713105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e9c0b2650 msgr2=0x7f0e9c0b2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.986+0000 7f0ea3070640 1 --2- 172.21.15.63:0/2123713105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e9c0b2650 0x7f0e9c0b2a60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c08d550 tx=0x7f0e9402aa30 comp rx=0 tx=0).stop 2024-09-21T07:00:51.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.986+0000 7f0ea3070640 1 -- 172.21.15.63:0/2123713105 shutdown_connections 2024-09-21T07:00:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.986+0000 7f0ea3070640 1 --2- 172.21.15.63:0/2123713105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e9c0b2650 0x7f0e9c0b2a60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.986+0000 7f0ea3070640 1 --2- 172.21.15.63:0/2123713105 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0e9c15ef00 0x7f0e9c0d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.986+0000 7f0ea3070640 1 --2- 172.21.15.63:0/2123713105 >> v2:172.21.15.71:3300/0 conn(0x7f0e9c0b7530 0x7f0e9c0d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.986+0000 7f0ea3070640 1 -- 172.21.15.63:0/2123713105 >> 172.21.15.63:0/2123713105 conn(0x7f0e9c08bfd0 msgr2=0x7f0e9c0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.986+0000 7f0ea3070640 1 -- 172.21.15.63:0/2123713105 shutdown_connections 2024-09-21T07:00:51.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.986+0000 7f0ea3070640 1 -- 172.21.15.63:0/2123713105 wait complete. 2024-09-21T07:00:51.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.988+0000 7f0ea3070640 1 Processor -- start 2024-09-21T07:00:51.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.988+0000 7f0ea3070640 1 -- start start 2024-09-21T07:00:51.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea3070640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e9c0b2650 0x7f0e9c0b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:51.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea3070640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0e9c0b7530 0x7f0e9c0c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:51.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea3070640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e9c15ef00 0x7f0e9c0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:51.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea3070640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c0b3330 con 0x7f0e9c0b2650 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea3070640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c0b31b0 con 0x7f0e9c15ef00 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea3070640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9c0b34b0 con 0x7f0e9c0b7530 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea0e0c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e9c0b2650 0x7f0e9c0b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea0e0c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e9c0b2650 0x7f0e9c0b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45492/0 (socket says 172.21.15.63:45492) 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea0e0c640 1 -- 172.21.15.63:0/3000649291 learned_addr learned my addr 172.21.15.63:0/3000649291 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea160d640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e9c15ef00 0x7f0e9c0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0e9bfff640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0e9c0b7530 0x7f0e9c0c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea0e0c640 1 -- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0e9c0b7530 msgr2=0x7f0e9c0c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea0e0c640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0e9c0b7530 0x7f0e9c0c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea0e0c640 1 -- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e9c15ef00 msgr2=0x7f0e9c0cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea0e0c640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e9c15ef00 0x7f0e9c0cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea0e0c640 1 -- 172.21.15.63:0/3000649291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9c0ca4b0 con 0x7f0e9c0b2650 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea160d640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e9c15ef00 0x7f0e9c0cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:51.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea0e0c640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e9c0b2650 0x7f0e9c0b5130 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00c940 tx=0x7f0e8c00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:51.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0e997fa640 1 -- 172.21.15.63:0/3000649291 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c004230 con 0x7f0e9c0b2650 2024-09-21T07:00:51.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0e997fa640 1 -- 172.21.15.63:0/3000649291 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e8c0044c0 con 0x7f0e9c0b2650 2024-09-21T07:00:51.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea3070640 1 -- 172.21.15.63:0/3000649291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9c0b3db0 con 0x7f0e9c0b2650 2024-09-21T07:00:51.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0e997fa640 1 -- 172.21.15.63:0/3000649291 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c007c10 con 0x7f0e9c0b2650 2024-09-21T07:00:51.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.990+0000 7f0ea3070640 1 -- 172.21.15.63:0/3000649291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e9c0b4370 con 0x7f0e9c0b2650 2024-09-21T07:00:51.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.991+0000 7f0ea3070640 1 -- 172.21.15.63:0/3000649291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e9c0b2a60 con 0x7f0e9c0b2650 2024-09-21T07:00:51.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.992+0000 7f0e997fa640 1 -- 172.21.15.63:0/3000649291 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e8c005020 con 0x7f0e9c0b2650 2024-09-21T07:00:51.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.993+0000 7f0e997fa640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0e88078bc0 0x7f0e8807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:51.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.993+0000 7f0e997fa640 1 -- 172.21.15.63:0/3000649291 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0e8c09b660 con 0x7f0e9c0b2650 2024-09-21T07:00:51.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.993+0000 7f0e9bfff640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0e88078bc0 0x7f0e8807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:51.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.994+0000 7f0e9bfff640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0e88078bc0 0x7f0e8807b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c1ec920 tx=0x7f0e9000c440 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:51.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:51.998+0000 7f0e997fa640 1 -- 172.21.15.63:0/3000649291 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0e8c014070 con 0x7f0e9c0b2650 2024-09-21T07:00:52.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.186+0000 7f0ea3070640 1 -- 172.21.15.63:0/3000649291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e9c06a130 con 0x7f0e9c0b2650 2024-09-21T07:00:52.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.187+0000 7f0e997fa640 1 -- 172.21.15.63:0/3000649291 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7f0e8c063aa0 con 0x7f0e9c0b2650 2024-09-21T07:00:52.189 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:52.189 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:00:22.544759+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:00:18.869431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:00:19.879189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:00:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.190+0000 7f0ea3070640 1 -- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0e88078bc0 msgr2=0x7f0e8807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.190+0000 7f0ea3070640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0e88078bc0 0x7f0e8807b0d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c1ec920 tx=0x7f0e9000c440 comp rx=0 tx=0).stop 2024-09-21T07:00:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.190+0000 7f0ea3070640 1 -- 172.21.15.63:0/3000649291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e9c0b2650 msgr2=0x7f0e9c0b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.190+0000 7f0ea3070640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e9c0b2650 0x7f0e9c0b5130 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00c940 tx=0x7f0e8c00ce00 comp rx=0 tx=0).stop 2024-09-21T07:00:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.190+0000 7f0ea3070640 1 -- 172.21.15.63:0/3000649291 shutdown_connections 2024-09-21T07:00:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.190+0000 7f0ea3070640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0e88078bc0 0x7f0e8807b0d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.190+0000 7f0ea3070640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e9c15ef00 0x7f0e9c0cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.190+0000 7f0ea3070640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0e9c0b7530 0x7f0e9c0c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.190+0000 7f0ea3070640 1 --2- 172.21.15.63:0/3000649291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0e9c0b2650 0x7f0e9c0b5130 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.190+0000 7f0ea3070640 1 -- 172.21.15.63:0/3000649291 >> 172.21.15.63:0/3000649291 conn(0x7f0e9c08bfd0 msgr2=0x7f0e9c0d1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:52.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.190+0000 7f0ea3070640 1 -- 172.21.15.63:0/3000649291 shutdown_connections 2024-09-21T07:00:52.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.190+0000 7f0ea3070640 1 -- 172.21.15.63:0/3000649291 wait complete. 2024-09-21T07:00:52.203 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:00:52.204 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:00:52.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.318+0000 7f0ab92ec640 1 -- 172.21.15.63:0/1839063355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab40b3b60 msgr2=0x7f0ab40ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:52.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.318+0000 7f0ab92ec640 1 --2- 172.21.15.63:0/1839063355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab40b3b60 0x7f0ab40ce440 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009830 tx=0x7f0aac02a5c0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.318+0000 7f0ab92ec640 1 -- 172.21.15.63:0/1839063355 shutdown_connections 2024-09-21T07:00:52.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.318+0000 7f0ab92ec640 1 --2- 172.21.15.63:0/1839063355 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab40b3b60 0x7f0ab40ce440 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.318+0000 7f0ab92ec640 1 -- 172.21.15.63:0/1839063355 >> 172.21.15.63:0/1839063355 conn(0x7f0ab40b3fb0 msgr2=0x7f0ab40b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:52.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.318+0000 7f0ab92ec640 1 -- 172.21.15.63:0/1839063355 shutdown_connections 2024-09-21T07:00:52.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.318+0000 7f0ab92ec640 1 -- 172.21.15.63:0/1839063355 wait complete. 2024-09-21T07:00:52.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.320+0000 7f0ab92ec640 1 Processor -- start 2024-09-21T07:00:52.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.320+0000 7f0ab92ec640 1 -- start start 2024-09-21T07:00:52.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.321+0000 7f0ab92ec640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab40b3750 0x7f0ab4157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:52.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.321+0000 7f0ab92ec640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ab40b3b60 0x7f0ab4154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:52.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.321+0000 7f0ab92ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab4154ec0 0x7f0ab40cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:52.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.321+0000 7f0ab92ec640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab4167cf0 con 0x7f0ab4154ec0 2024-09-21T07:00:52.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.321+0000 7f0ab92ec640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab4167b70 con 0x7f0ab40b3750 2024-09-21T07:00:52.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.321+0000 7f0ab92ec640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0ab4167e70 con 0x7f0ab40b3b60 2024-09-21T07:00:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.321+0000 7f0ab37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab4154ec0 0x7f0ab40cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.321+0000 7f0ab37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab4154ec0 0x7f0ab40cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45508/0 (socket says 172.21.15.63:45508) 2024-09-21T07:00:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.321+0000 7f0ab37fe640 1 -- 172.21.15.63:0/2877488044 learned_addr learned my addr 172.21.15.63:0/2877488044 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.321+0000 7f0ab2ffd640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab40b3750 0x7f0ab4157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0ab27fc640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ab40b3b60 0x7f0ab4154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0ab37fe640 1 -- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ab40b3b60 msgr2=0x7f0ab4154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0ab37fe640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ab40b3b60 0x7f0ab4154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0ab37fe640 1 -- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab40b3750 msgr2=0x7f0ab4157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0ab37fe640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab40b3750 0x7f0ab4157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0ab37fe640 1 -- 172.21.15.63:0/2877488044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab41578f0 con 0x7f0ab4154ec0 2024-09-21T07:00:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0ab2ffd640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab40b3750 0x7f0ab4157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0ab27fc640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ab40b3b60 0x7f0ab4154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:52.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0ab37fe640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab4154ec0 0x7f0ab40cad60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0aac02abb0 tx=0x7f0aac033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:52.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0a9b7fe640 1 -- 172.21.15.63:0/2877488044 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac005c90 con 0x7f0ab4154ec0 2024-09-21T07:00:52.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0a9b7fe640 1 -- 172.21.15.63:0/2877488044 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0aac031e50 con 0x7f0ab4154ec0 2024-09-21T07:00:52.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0ab92ec640 1 -- 172.21.15.63:0/2877488044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab4157bd0 con 0x7f0ab4154ec0 2024-09-21T07:00:52.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0a9b7fe640 1 -- 172.21.15.63:0/2877488044 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac005260 con 0x7f0ab4154ec0 2024-09-21T07:00:52.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.322+0000 7f0ab92ec640 1 -- 172.21.15.63:0/2877488044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab406df60 con 0x7f0ab4154ec0 2024-09-21T07:00:52.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.323+0000 7f0ab92ec640 1 -- 172.21.15.63:0/2877488044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab409aa40 con 0x7f0ab4154ec0 2024-09-21T07:00:52.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.324+0000 7f0a9b7fe640 1 -- 172.21.15.63:0/2877488044 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0aac005400 con 0x7f0ab4154ec0 2024-09-21T07:00:52.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.324+0000 7f0a9b7fe640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0aa0078b90 0x7f0aa007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:52.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.325+0000 7f0a9b7fe640 1 -- 172.21.15.63:0/2877488044 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0aac0bbe60 con 0x7f0ab4154ec0 2024-09-21T07:00:52.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.325+0000 7f0ab2ffd640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0aa0078b90 0x7f0aa007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:52.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.325+0000 7f0ab2ffd640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0aa0078b90 0x7f0aa007b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4001da0 tx=0x7f0aa4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:52.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.329+0000 7f0a9b7fe640 1 -- 172.21.15.63:0/2877488044 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0aac03f030 con 0x7f0ab4154ec0 2024-09-21T07:00:52.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.555+0000 7f0ab92ec640 1 -- 172.21.15.63:0/2877488044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ab40ce760 con 0x7f0ab4154ec0 2024-09-21T07:00:52.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.555+0000 7f0a9b7fe640 1 -- 172.21.15.63:0/2877488044 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5208 (secure 0 0 0) 0x7f0aac031770 con 0x7f0ab4154ec0 2024-09-21T07:00:52.557 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:52.557 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-21T07:00:24:568573+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/4041704430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":4041704430},{"type":"v1","addr":"172.21.15.63:6834","nonce":4041704430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1032053510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":1032053510},{"type":"v1","addr":"172.21.15.63:6835","nonce":1032053510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/18747791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":18747791},{"type":"v1","addr":"172.21.15.71:6836","nonce":18747791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:00:20.923025+0000","modified":"2024-09-21T07:00:23.948505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/767391345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":767391345},{"type":"v1","addr":"172.21.15.71:6837","nonce":767391345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T07:00:52.558 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-21T07:00:52.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.558+0000 7f0ab92ec640 1 -- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0aa0078b90 msgr2=0x7f0aa007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:52.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.558+0000 7f0ab92ec640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0aa0078b90 0x7f0aa007b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4001da0 tx=0x7f0aa4009040 comp rx=0 tx=0).stop 2024-09-21T07:00:52.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.558+0000 7f0ab92ec640 1 -- 172.21.15.63:0/2877488044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab4154ec0 msgr2=0x7f0ab40cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:52.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.558+0000 7f0ab92ec640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab4154ec0 0x7f0ab40cad60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0aac02abb0 tx=0x7f0aac033c20 comp rx=0 tx=0).stop 2024-09-21T07:00:52.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.558+0000 7f0ab92ec640 1 -- 172.21.15.63:0/2877488044 shutdown_connections 2024-09-21T07:00:52.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.558+0000 7f0ab92ec640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0aa0078b90 0x7f0aa007b0a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.558+0000 7f0ab92ec640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ab4154ec0 0x7f0ab40cad60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.558+0000 7f0ab92ec640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ab40b3b60 0x7f0ab4154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.558+0000 7f0ab92ec640 1 --2- 172.21.15.63:0/2877488044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ab40b3750 0x7f0ab4157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.558+0000 7f0ab92ec640 1 -- 172.21.15.63:0/2877488044 >> 172.21.15.63:0/2877488044 conn(0x7f0ab40b3fb0 msgr2=0x7f0ab4071500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:52.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.558+0000 7f0ab92ec640 1 -- 172.21.15.63:0/2877488044 shutdown_connections 2024-09-21T07:00:52.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.558+0000 7f0ab92ec640 1 -- 172.21.15.63:0/2877488044 wait complete. 2024-09-21T07:00:52.571 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:00:52.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.686+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2937462603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae40b3aa0 msgr2=0x7f6ae40d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:52.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.686+0000 7f6aea5ad640 1 --2- 172.21.15.63:0/2937462603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae40b3aa0 0x7f6ae40d2fd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6ae406d790 tx=0x7f6ad402a560 comp rx=0 tx=0).stop 2024-09-21T07:00:52.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.686+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2937462603 shutdown_connections 2024-09-21T07:00:52.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.686+0000 7f6aea5ad640 1 --2- 172.21.15.63:0/2937462603 >> v2:172.21.15.71:3300/0 conn(0x7f6ae40d1300 0x7f6ae406e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.686+0000 7f6aea5ad640 1 --2- 172.21.15.63:0/2937462603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae40b3aa0 0x7f6ae40d2fd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.686+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2937462603 >> 172.21.15.63:0/2937462603 conn(0x7f6ae40d45e0 msgr2=0x7f6ae40d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:52.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.686+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2937462603 shutdown_connections 2024-09-21T07:00:52.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.686+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2937462603 wait complete. 2024-09-21T07:00:52.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.688+0000 7f6aea5ad640 1 Processor -- start 2024-09-21T07:00:52.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.688+0000 7f6aea5ad640 1 -- start start 2024-09-21T07:00:52.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.689+0000 7f6aea5ad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae40b3aa0 0x7f6ae4154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:52.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.689+0000 7f6aea5ad640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae40b9aa0 0x7f6ae4161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.689+0000 7f6aea5ad640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae40cab80 0x7f6ae4161870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.689+0000 7f6aea5ad640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae40d03d0 con 0x7f6ae40b3aa0 2024-09-21T07:00:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.689+0000 7f6aea5ad640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae408cb70 con 0x7f6ae40b9aa0 2024-09-21T07:00:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.689+0000 7f6aea5ad640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae406ee70 con 0x7f6ae40cab80 2024-09-21T07:00:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae40b3aa0 0x7f6ae4154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae40b3aa0 0x7f6ae4154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45524/0 (socket says 172.21.15.63:45524) 2024-09-21T07:00:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae3fff640 1 -- 172.21.15.63:0/2141473853 learned_addr learned my addr 172.21.15.63:0/2141473853 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae37fe640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae40b9aa0 0x7f6ae4161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae8b4a640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae40cab80 0x7f6ae4161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae3fff640 1 -- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae40cab80 msgr2=0x7f6ae4161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae3fff640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae40cab80 0x7f6ae4161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae3fff640 1 -- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae40b9aa0 msgr2=0x7f6ae4161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:52.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae3fff640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae40b9aa0 0x7f6ae4161330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae3fff640 1 -- 172.21.15.63:0/2141473853 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae41f5880 con 0x7f6ae40b3aa0 2024-09-21T07:00:52.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae3fff640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae40b3aa0 0x7f6ae4154830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ad402ab50 tx=0x7f6ad40049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:52.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae0ff9640 1 -- 172.21.15.63:0/2141473853 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4031950 con 0x7f6ae40b3aa0 2024-09-21T07:00:52.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae0ff9640 1 -- 172.21.15.63:0/2141473853 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ad4031be0 con 0x7f6ae40b3aa0 2024-09-21T07:00:52.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2141473853 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae41f5b60 con 0x7f6ae40b3aa0 2024-09-21T07:00:52.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6ae0ff9640 1 -- 172.21.15.63:0/2141473853 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40330d0 con 0x7f6ae40b3aa0 2024-09-21T07:00:52.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.690+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2141473853 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae41f6120 con 0x7f6ae40b3aa0 2024-09-21T07:00:52.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.691+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2141473853 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae406f2c0 con 0x7f6ae40b3aa0 2024-09-21T07:00:52.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.692+0000 7f6ae0ff9640 1 -- 172.21.15.63:0/2141473853 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ad4033290 con 0x7f6ae40b3aa0 2024-09-21T07:00:52.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.693+0000 7f6ae0ff9640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6ad0078b90 0x7f6ad007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:52.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.693+0000 7f6ae0ff9640 1 -- 172.21.15.63:0/2141473853 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6ad40bbf70 con 0x7f6ae40b3aa0 2024-09-21T07:00:52.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.693+0000 7f6ae37fe640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6ad0078b90 0x7f6ad007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:52.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.694+0000 7f6ae37fe640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6ad0078b90 0x7f6ad007b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6ae415d4b0 tx=0x7f6ad8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:52.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.697+0000 7f6ae0ff9640 1 -- 172.21.15.63:0/2141473853 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6ad403f030 con 0x7f6ae40b3aa0 2024-09-21T07:00:52.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.924+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2141473853 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ae415edb0 con 0x7f6ae40b3aa0 2024-09-21T07:00:52.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.925+0000 7f6ae0ff9640 1 -- 172.21.15.63:0/2141473853 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5208 (secure 0 0 0) 0x7f6ad4031770 con 0x7f6ae40b3aa0 2024-09-21T07:00:52.927 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:52.927 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":8,"btime":"2024-09-21T07:00:24:568573+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/4041704430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":4041704430},{"type":"v1","addr":"172.21.15.63:6834","nonce":4041704430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4393,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/1032053510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":1032053510},{"type":"v1","addr":"172.21.15.63:6835","nonce":1032053510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/18747791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":18747791},{"type":"v1","addr":"172.21.15.71:6836","nonce":18747791}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:00:20.923025+0000","modified":"2024-09-21T07:00:23.948505+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4410":{"gid":4410,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.71:6837/767391345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":767391345},{"type":"v1","addr":"172.21.15.71:6837","nonce":767391345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4410,"qdb_cluster":[4410]},"id":1}]} 2024-09-21T07:00:52.927 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 8 2024-09-21T07:00:52.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.927+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6ad0078b90 msgr2=0x7f6ad007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:52.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.927+0000 7f6aea5ad640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6ad0078b90 0x7f6ad007b0a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6ae415d4b0 tx=0x7f6ad8009040 comp rx=0 tx=0).stop 2024-09-21T07:00:52.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.927+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2141473853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae40b3aa0 msgr2=0x7f6ae4154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:52.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.927+0000 7f6aea5ad640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae40b3aa0 0x7f6ae4154830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ad402ab50 tx=0x7f6ad40049d0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.927+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2141473853 shutdown_connections 2024-09-21T07:00:52.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.927+0000 7f6aea5ad640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6ad0078b90 0x7f6ad007b0a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.927+0000 7f6aea5ad640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6ae40cab80 0x7f6ae4161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.927+0000 7f6aea5ad640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae40b9aa0 0x7f6ae4161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.927+0000 7f6aea5ad640 1 --2- 172.21.15.63:0/2141473853 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ae40b3aa0 0x7f6ae4154830 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:52.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.927+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2141473853 >> 172.21.15.63:0/2141473853 conn(0x7f6ae40d45e0 msgr2=0x7f6ae4075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:52.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.927+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2141473853 shutdown_connections 2024-09-21T07:00:52.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:52.927+0000 7f6aea5ad640 1 -- 172.21.15.63:0/2141473853 wait complete. 2024-09-21T07:00:52.940 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:00:53.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.055+0000 7fcdb3acc640 1 -- 172.21.15.63:0/3776684050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0d2c40 msgr2=0x7fcdac1698f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:53.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.055+0000 7fcdb3acc640 1 --2- 172.21.15.63:0/3776684050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0d2c40 0x7fcdac1698f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcda4005fd0 tx=0x7fcda402a8d0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.055+0000 7fcdb3acc640 1 -- 172.21.15.63:0/3776684050 shutdown_connections 2024-09-21T07:00:53.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.055+0000 7fcdb3acc640 1 --2- 172.21.15.63:0/3776684050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0d2c40 0x7fcdac1698f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.055+0000 7fcdb3acc640 1 -- 172.21.15.63:0/3776684050 >> 172.21.15.63:0/3776684050 conn(0x7fcdac08bfd0 msgr2=0x7fcdac0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:53.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.055+0000 7fcdb3acc640 1 -- 172.21.15.63:0/3776684050 shutdown_connections 2024-09-21T07:00:53.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.055+0000 7fcdb3acc640 1 -- 172.21.15.63:0/3776684050 wait complete. 2024-09-21T07:00:53.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.057+0000 7fcdb3acc640 1 Processor -- start 2024-09-21T07:00:53.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.057+0000 7fcdb3acc640 1 -- start start 2024-09-21T07:00:53.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb3acc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac0b7530 0x7fcdac1f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:53.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb3acc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0d2c40 0x7fcdac0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:53.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb3acc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcdac15ef00 0x7fcdac1f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:53.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb3acc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac16a040 con 0x7fcdac0b7530 2024-09-21T07:00:53.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb3acc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac0d5590 con 0x7fcdac0d2c40 2024-09-21T07:00:53.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb3acc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcdac16a1c0 con 0x7fcdac15ef00 2024-09-21T07:00:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb1868640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac0b7530 0x7fcdac1f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb1868640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac0b7530 0x7fcdac1f6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45536/0 (socket says 172.21.15.63:45536) 2024-09-21T07:00:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb1868640 1 -- 172.21.15.63:0/2495970883 learned_addr learned my addr 172.21.15.63:0/2495970883 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb1067640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0d2c40 0x7fcdac0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb2069640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcdac15ef00 0x7fcdac1f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb1868640 1 -- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcdac15ef00 msgr2=0x7fcdac1f90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb1868640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcdac15ef00 0x7fcdac1f90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.058+0000 7fcdb1868640 1 -- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0d2c40 msgr2=0x7fcdac0cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.059+0000 7fcdb1868640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0d2c40 0x7fcdac0cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.059+0000 7fcdb1868640 1 -- 172.21.15.63:0/2495970883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdac1f9c10 con 0x7fcdac0b7530 2024-09-21T07:00:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.059+0000 7fcdb1067640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0d2c40 0x7fcdac0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.059+0000 7fcdb1868640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac0b7530 0x7fcdac1f6600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcda800c3c0 tx=0x7fcda800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:53.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.059+0000 7fcd9e7fc640 1 -- 172.21.15.63:0/2495970883 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda8017070 con 0x7fcdac0b7530 2024-09-21T07:00:53.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.059+0000 7fcd9e7fc640 1 -- 172.21.15.63:0/2495970883 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcda80053c0 con 0x7fcdac0b7530 2024-09-21T07:00:53.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.059+0000 7fcdb3acc640 1 -- 172.21.15.63:0/2495970883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdac1f9ef0 con 0x7fcdac0b7530 2024-09-21T07:00:53.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.059+0000 7fcd9e7fc640 1 -- 172.21.15.63:0/2495970883 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda80038a0 con 0x7fcdac0b7530 2024-09-21T07:00:53.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.059+0000 7fcdb3acc640 1 -- 172.21.15.63:0/2495970883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdac0ce4f0 con 0x7fcdac0b7530 2024-09-21T07:00:53.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.060+0000 7fcdb3acc640 1 -- 172.21.15.63:0/2495970883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdac0d2530 con 0x7fcdac0b7530 2024-09-21T07:00:53.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.061+0000 7fcd9e7fc640 1 -- 172.21.15.63:0/2495970883 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcda801a070 con 0x7fcdac0b7530 2024-09-21T07:00:53.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.061+0000 7fcd9e7fc640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcd90078b90 0x7fcd9007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:53.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.061+0000 7fcd9e7fc640 1 -- 172.21.15.63:0/2495970883 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fcda809a0f0 con 0x7fcdac0b7530 2024-09-21T07:00:53.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.061+0000 7fcdb1067640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcd90078b90 0x7fcd9007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:53.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.062+0000 7fcdb1067640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcd90078b90 0x7fcd9007b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcdac1622a0 tx=0x7fcda0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:53.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.066+0000 7fcd9e7fc640 1 -- 172.21.15.63:0/2495970883 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcda8062530 con 0x7fcdac0b7530 2024-09-21T07:00:53.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.254+0000 7fcdb3acc640 1 -- 172.21.15.63:0/2495970883 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcdac06a130 con 0x7fcdac0b7530 2024-09-21T07:00:53.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.255+0000 7fcd9e7fc640 1 -- 172.21.15.63:0/2495970883 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16621 (secure 0 0 0) 0x7fcda8061e30 con 0x7fcdac0b7530 2024-09-21T07:00:53.258 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:53.258 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:00:22.544759+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:00:18.869431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T07:00:19.879189+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:00:53.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.257+0000 7fcdb3acc640 1 -- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcd90078b90 msgr2=0x7fcd9007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:53.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.257+0000 7fcdb3acc640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcd90078b90 0x7fcd9007b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcdac1622a0 tx=0x7fcda0009040 comp rx=0 tx=0).stop 2024-09-21T07:00:53.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.257+0000 7fcdb3acc640 1 -- 172.21.15.63:0/2495970883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac0b7530 msgr2=0x7fcdac1f6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:53.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.257+0000 7fcdb3acc640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac0b7530 0x7fcdac1f6600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcda800c3c0 tx=0x7fcda800c880 comp rx=0 tx=0).stop 2024-09-21T07:00:53.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.257+0000 7fcdb3acc640 1 -- 172.21.15.63:0/2495970883 shutdown_connections 2024-09-21T07:00:53.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.257+0000 7fcdb3acc640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcd90078b90 0x7fcd9007b0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.257+0000 7fcdb3acc640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcdac15ef00 0x7fcdac1f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.257+0000 7fcdb3acc640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdac0d2c40 0x7fcdac0cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.257+0000 7fcdb3acc640 1 --2- 172.21.15.63:0/2495970883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcdac0b7530 0x7fcdac1f6600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.257+0000 7fcdb3acc640 1 -- 172.21.15.63:0/2495970883 >> 172.21.15.63:0/2495970883 conn(0x7fcdac08bfd0 msgr2=0x7fcdac0b9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:53.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.257+0000 7fcdb3acc640 1 -- 172.21.15.63:0/2495970883 shutdown_connections 2024-09-21T07:00:53.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.257+0000 7fcdb3acc640 1 -- 172.21.15.63:0/2495970883 wait complete. 2024-09-21T07:00:53.271 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:00:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.387+0000 7f56a53c6640 1 -- 172.21.15.63:0/858327851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a0070a60 msgr2=0x7f56a006f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.387+0000 7f56a53c6640 1 --2- 172.21.15.63:0/858327851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a0070a60 0x7f56a006f8e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f56a0073330 tx=0x7f568802a530 comp rx=0 tx=0).stop 2024-09-21T07:00:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.387+0000 7f56a53c6640 1 -- 172.21.15.63:0/858327851 shutdown_connections 2024-09-21T07:00:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.387+0000 7f56a53c6640 1 --2- 172.21.15.63:0/858327851 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a0070a60 0x7f56a006f8e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.387+0000 7f56a53c6640 1 --2- 172.21.15.63:0/858327851 >> v2:172.21.15.71:3300/0 conn(0x7f56a00ccea0 0x7f56a0070520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.387+0000 7f56a53c6640 1 -- 172.21.15.63:0/858327851 >> 172.21.15.63:0/858327851 conn(0x7f56a00cd510 msgr2=0x7f56a00cd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.387+0000 7f56a53c6640 1 -- 172.21.15.63:0/858327851 shutdown_connections 2024-09-21T07:00:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.387+0000 7f56a53c6640 1 -- 172.21.15.63:0/858327851 wait complete. 2024-09-21T07:00:53.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.389+0000 7f56a53c6640 1 Processor -- start 2024-09-21T07:00:53.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.389+0000 7f56a53c6640 1 -- start start 2024-09-21T07:00:53.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f56a53c6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a006fe20 0x7f56a015c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:53.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f56a53c6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f56a0070a60 0x7f56a01f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f56a53c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56a00ccea0 0x7f56a01f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f56a53c6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f56a0160aa0 con 0x7f56a006fe20 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f56a53c6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56a00cc300 con 0x7f56a00ccea0 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f56a53c6640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f56a0160c20 con 0x7f56a0070a60 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f569effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a006fe20 0x7f56a015c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f569effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a006fe20 0x7f56a015c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45562/0 (socket says 172.21.15.63:45562) 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f569effd640 1 -- 172.21.15.63:0/1392042184 learned_addr learned my addr 172.21.15.63:0/1392042184 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f569f7fe640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56a00ccea0 0x7f56a01f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f569e7fc640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f56a0070a60 0x7f56a01f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f569effd640 1 -- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f56a0070a60 msgr2=0x7f56a01f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f569effd640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f56a0070a60 0x7f56a01f69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f569effd640 1 -- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56a00ccea0 msgr2=0x7f56a01f6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f569effd640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56a00ccea0 0x7f56a01f6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f569effd640 1 -- 172.21.15.63:0/1392042184 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a01f76f0 con 0x7f56a006fe20 2024-09-21T07:00:53.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.391+0000 7f569effd640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a006fe20 0x7f56a015c6b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f569000c970 tx=0x7f569000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:53.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.392+0000 7f56977fe640 1 -- 172.21.15.63:0/1392042184 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5690007bb0 con 0x7f56a006fe20 2024-09-21T07:00:53.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.392+0000 7f56977fe640 1 -- 172.21.15.63:0/1392042184 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5690007e40 con 0x7f56a006fe20 2024-09-21T07:00:53.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.392+0000 7f56a53c6640 1 -- 172.21.15.63:0/1392042184 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a01f3600 con 0x7f56a006fe20 2024-09-21T07:00:53.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.392+0000 7f56977fe640 1 -- 172.21.15.63:0/1392042184 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569000f690 con 0x7f56a006fe20 2024-09-21T07:00:53.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.392+0000 7f56a53c6640 1 -- 172.21.15.63:0/1392042184 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a01f3bc0 con 0x7f56a006fe20 2024-09-21T07:00:53.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.393+0000 7f56a53c6640 1 -- 172.21.15.63:0/1392042184 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56a01f33f0 con 0x7f56a006fe20 2024-09-21T07:00:53.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.394+0000 7f56977fe640 1 -- 172.21.15.63:0/1392042184 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f569000f830 con 0x7f56a006fe20 2024-09-21T07:00:53.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.395+0000 7f56977fe640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5680078bc0 0x7f568007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:53.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.395+0000 7f56977fe640 1 -- 172.21.15.63:0/1392042184 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f569009b430 con 0x7f56a006fe20 2024-09-21T07:00:53.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.395+0000 7f569e7fc640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5680078bc0 0x7f568007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:53.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.395+0000 7f569e7fc640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5680078bc0 0x7f568007b0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5688034000 tx=0x7f5688004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:53.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.399+0000 7f56977fe640 1 -- 172.21.15.63:0/1392042184 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5690014030 con 0x7f56a006fe20 2024-09-21T07:00:53.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.630+0000 7f56a53c6640 1 -- 172.21.15.63:0/1392042184 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f56a01610f0 con 0x7f56a006fe20 2024-09-21T07:00:53.633 INFO:tasks.ceph.mon.a.smithi063.stderr:2024-09-21T07:00:53.631+0000 7fed43401640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:00:53.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.633+0000 7f56977fe640 1 -- 172.21.15.63:0/1392042184 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f5690063220 con 0x7f56a006fe20 2024-09-21T07:00:53.634 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:00:53.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.636+0000 7f56a53c6640 1 -- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5680078bc0 msgr2=0x7f568007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:53.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.636+0000 7f56a53c6640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5680078bc0 0x7f568007b0d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5688034000 tx=0x7f5688004730 comp rx=0 tx=0).stop 2024-09-21T07:00:53.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.636+0000 7f56a53c6640 1 -- 172.21.15.63:0/1392042184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a006fe20 msgr2=0x7f56a015c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:53.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.636+0000 7f56a53c6640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a006fe20 0x7f56a015c6b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f569000c970 tx=0x7f569000ce30 comp rx=0 tx=0).stop 2024-09-21T07:00:53.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.636+0000 7f56a53c6640 1 -- 172.21.15.63:0/1392042184 shutdown_connections 2024-09-21T07:00:53.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.636+0000 7f56a53c6640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5680078bc0 0x7f568007b0d0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5688034000 tx=0x7f5688004730 comp rx=0 tx=0).stop 2024-09-21T07:00:53.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.636+0000 7f56a53c6640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56a00ccea0 0x7f56a01f6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.636+0000 7f56a53c6640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f56a0070a60 0x7f56a01f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.636+0000 7f56a53c6640 1 --2- 172.21.15.63:0/1392042184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f56a006fe20 0x7f56a015c6b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.636+0000 7f56a53c6640 1 -- 172.21.15.63:0/1392042184 >> 172.21.15.63:0/1392042184 conn(0x7f56a00cd510 msgr2=0x7f56a006d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:53.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.636+0000 7f56a53c6640 1 -- 172.21.15.63:0/1392042184 shutdown_connections 2024-09-21T07:00:53.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.636+0000 7f56a53c6640 1 -- 172.21.15.63:0/1392042184 wait complete. 2024-09-21T07:00:53.641 INFO:tasks.ceph.mds.b.smithi071.stderr: -8423> 2024-09-21T07:00:15.514+0000 7ff05de2a640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-21T07:00:53.642 INFO:tasks.ceph.mds.b.smithi071.stderr: -7026> 2024-09-21T07:00:26.516+0000 7ff057e1e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:00:53.649 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:00:53.702 INFO:tasks.ceph.mds.b.smithi071.stdout:starting mds.b at 2024-09-21T07:00:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.769+0000 7f344abc6640 1 -- 172.21.15.63:0/4126858568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34440cf640 msgr2=0x7f34440cfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.769+0000 7f344abc6640 1 --2- 172.21.15.63:0/4126858568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34440cf640 0x7f34440cfa50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3444073e00 tx=0x7f343402aa30 comp rx=0 tx=0).stop 2024-09-21T07:00:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.769+0000 7f344abc6640 1 -- 172.21.15.63:0/4126858568 shutdown_connections 2024-09-21T07:00:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.769+0000 7f344abc6640 1 --2- 172.21.15.63:0/4126858568 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f34440b5c90 0x7f34440b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.769+0000 7f344abc6640 1 --2- 172.21.15.63:0/4126858568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34440cf640 0x7f34440cfa50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.769+0000 7f344abc6640 1 --2- 172.21.15.63:0/4126858568 >> v2:172.21.15.71:3300/0 conn(0x7f34440c61e0 0x7f34440d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.769+0000 7f344abc6640 1 -- 172.21.15.63:0/4126858568 >> 172.21.15.63:0/4126858568 conn(0x7f34440b2f70 msgr2=0x7f34440b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.769+0000 7f344abc6640 1 -- 172.21.15.63:0/4126858568 shutdown_connections 2024-09-21T07:00:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.769+0000 7f344abc6640 1 -- 172.21.15.63:0/4126858568 wait complete. 2024-09-21T07:00:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.771+0000 7f344abc6640 1 Processor -- start 2024-09-21T07:00:53.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.771+0000 7f344abc6640 1 -- start start 2024-09-21T07:00:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.772+0000 7f344abc6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34440b5c90 0x7f34441e4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.772+0000 7f344abc6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34440c61e0 0x7f34440b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.772+0000 7f344abc6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f34440cf640 0x7f34440b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.772+0000 7f344abc6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f34440b6970 con 0x7f34440b5c90 2024-09-21T07:00:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.772+0000 7f344abc6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f34440b67f0 con 0x7f34440c61e0 2024-09-21T07:00:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.772+0000 7f344abc6640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f34440b4270 con 0x7f34440cf640 2024-09-21T07:00:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.772+0000 7f3448962640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34440b5c90 0x7f34441e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:53.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.772+0000 7f3448962640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34440b5c90 0x7f34441e4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45578/0 (socket says 172.21.15.63:45578) 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.772+0000 7f3448962640 1 -- 172.21.15.63:0/1942510964 learned_addr learned my addr 172.21.15.63:0/1942510964 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f3443fff640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34440c61e0 0x7f34440b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f3449163640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f34440cf640 0x7f34440b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f3448962640 1 -- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f34440cf640 msgr2=0x7f34440b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f3448962640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f34440cf640 0x7f34440b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f3448962640 1 -- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34440c61e0 msgr2=0x7f34440b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f3448962640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34440c61e0 0x7f34440b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f3448962640 1 -- 172.21.15.63:0/1942510964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34441e55e0 con 0x7f34440b5c90 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f3449163640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f34440cf640 0x7f34440b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f3448962640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34440b5c90 0x7f34441e4960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f342c00e9f0 tx=0x7f342c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f34417fa640 1 -- 172.21.15.63:0/1942510964 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c00cd80 con 0x7f34440b5c90 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f34417fa640 1 -- 172.21.15.63:0/1942510964 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f342c004020 con 0x7f34440b5c90 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f344abc6640 1 -- 172.21.15.63:0/1942510964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34441e58c0 con 0x7f34440b5c90 2024-09-21T07:00:53.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f34417fa640 1 -- 172.21.15.63:0/1942510964 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c004470 con 0x7f34440b5c90 2024-09-21T07:00:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.773+0000 7f344abc6640 1 -- 172.21.15.63:0/1942510964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34441e5e80 con 0x7f34440b5c90 2024-09-21T07:00:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.774+0000 7f344abc6640 1 -- 172.21.15.63:0/1942510964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34440d0290 con 0x7f34440b5c90 2024-09-21T07:00:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.775+0000 7f34417fa640 1 -- 172.21.15.63:0/1942510964 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f342c0035f0 con 0x7f34440b5c90 2024-09-21T07:00:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.776+0000 7f34417fa640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3424078bc0 0x7f342407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:53.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.776+0000 7f34417fa640 1 -- 172.21.15.63:0/1942510964 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7f342c09bc50 con 0x7f34440b5c90 2024-09-21T07:00:53.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.776+0000 7f3443fff640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3424078bc0 0x7f342407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:53.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.777+0000 7f3443fff640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3424078bc0 0x7f342407b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3434035000 tx=0x7f3434004ab0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:53.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:53.784+0000 7f34417fa640 1 -- 172.21.15.63:0/1942510964 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f342c064030 con 0x7f34440b5c90 2024-09-21T07:00:54.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.011+0000 7f344abc6640 1 -- 172.21.15.63:0/1942510964 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3444071500 con 0x7f34440b5c90 2024-09-21T07:00:54.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.634+0000 7f34417fa640 1 -- 172.21.15.63:0/1942510964 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f342c063930 con 0x7f34440b5c90 2024-09-21T07:00:54.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.636+0000 7f344abc6640 1 -- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3424078bc0 msgr2=0x7f342407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:54.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.636+0000 7f344abc6640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3424078bc0 0x7f342407b0d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3434035000 tx=0x7f3434004ab0 comp rx=0 tx=0).stop 2024-09-21T07:00:54.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.636+0000 7f344abc6640 1 -- 172.21.15.63:0/1942510964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34440b5c90 msgr2=0x7f34441e4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.636+0000 7f344abc6640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34440b5c90 0x7f34441e4960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f342c00e9f0 tx=0x7f342c00eeb0 comp rx=0 tx=0).stop 2024-09-21T07:00:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.637+0000 7f344abc6640 1 -- 172.21.15.63:0/1942510964 shutdown_connections 2024-09-21T07:00:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.637+0000 7f344abc6640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3424078bc0 0x7f342407b0d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.637+0000 7f344abc6640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f34440cf640 0x7f34440b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.637+0000 7f344abc6640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f34440c61e0 0x7f34440b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.637+0000 7f344abc6640 1 --2- 172.21.15.63:0/1942510964 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34440b5c90 0x7f34441e4960 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.637+0000 7f344abc6640 1 -- 172.21.15.63:0/1942510964 >> 172.21.15.63:0/1942510964 conn(0x7f34440b2f70 msgr2=0x7f34440b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.637+0000 7f344abc6640 1 -- 172.21.15.63:0/1942510964 shutdown_connections 2024-09-21T07:00:54.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.637+0000 7f344abc6640 1 -- 172.21.15.63:0/1942510964 wait complete. 2024-09-21T07:00:54.650 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:00:54.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.771+0000 7fcb84a7e640 1 -- 172.21.15.63:0/3021209417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb800d07b0 msgr2=0x7fcb800cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:54.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.771+0000 7fcb84a7e640 1 --2- 172.21.15.63:0/3021209417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb800d07b0 0x7fcb800cd040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcb74005fd0 tx=0x7fcb7402a4b0 comp rx=0 tx=0).stop 2024-09-21T07:00:54.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.772+0000 7fcb84a7e640 1 -- 172.21.15.63:0/3021209417 shutdown_connections 2024-09-21T07:00:54.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.772+0000 7fcb84a7e640 1 --2- 172.21.15.63:0/3021209417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb800d07b0 0x7fcb800cd040 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:54.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.772+0000 7fcb84a7e640 1 --2- 172.21.15.63:0/3021209417 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb800ceaf0 0x7fcb800d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:54.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.772+0000 7fcb84a7e640 1 -- 172.21.15.63:0/3021209417 >> 172.21.15.63:0/3021209417 conn(0x7fcb800cef40 msgr2=0x7fcb800cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:54.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.772+0000 7fcb84a7e640 1 -- 172.21.15.63:0/3021209417 shutdown_connections 2024-09-21T07:00:54.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.772+0000 7fcb84a7e640 1 -- 172.21.15.63:0/3021209417 wait complete. 2024-09-21T07:00:54.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.773+0000 7fcb84a7e640 1 Processor -- start 2024-09-21T07:00:54.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.774+0000 7fcb84a7e640 1 -- start start 2024-09-21T07:00:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb84a7e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb800cd580 0x7fcb80151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb84a7e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb800ceaf0 0x7fcb8015d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb84a7e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb800d07b0 0x7fcb8006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb84a7e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcb800c9370 con 0x7fcb800ceaf0 2024-09-21T07:00:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb84a7e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcb800b31d0 con 0x7fcb800cd580 2024-09-21T07:00:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb84a7e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fcb80167190 con 0x7fcb800d07b0 2024-09-21T07:00:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb7dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb800ceaf0 0x7fcb8015d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb7dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb800ceaf0 0x7fcb8015d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45608/0 (socket says 172.21.15.63:45608) 2024-09-21T07:00:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb7dd9b640 1 -- 172.21.15.63:0/1849559686 learned_addr learned my addr 172.21.15.63:0/1849559686 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb7e59c640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb800cd580 0x7fcb80151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:54.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb7ed9d640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb800d07b0 0x7fcb8006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb7dd9b640 1 -- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb800d07b0 msgr2=0x7fcb8006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb7dd9b640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb800d07b0 0x7fcb8006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb7dd9b640 1 -- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb800cd580 msgr2=0x7fcb80151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb7dd9b640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb800cd580 0x7fcb80151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.775+0000 7fcb7dd9b640 1 -- 172.21.15.63:0/1849559686 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8015cc20 con 0x7fcb800ceaf0 2024-09-21T07:00:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.776+0000 7fcb7dd9b640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb800ceaf0 0x7fcb8015d9e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcb74034040 tx=0x7fcb740038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.776+0000 7fcb6effd640 1 -- 172.21.15.63:0/1849559686 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7403e030 con 0x7fcb800ceaf0 2024-09-21T07:00:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.776+0000 7fcb84a7e640 1 -- 172.21.15.63:0/1849559686 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8015cf00 con 0x7fcb800ceaf0 2024-09-21T07:00:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.776+0000 7fcb6effd640 1 -- 172.21.15.63:0/1849559686 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb74003d90 con 0x7fcb800ceaf0 2024-09-21T07:00:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.776+0000 7fcb6effd640 1 -- 172.21.15.63:0/1849559686 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74035040 con 0x7fcb800ceaf0 2024-09-21T07:00:54.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.776+0000 7fcb84a7e640 1 -- 172.21.15.63:0/1849559686 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb8015d4c0 con 0x7fcb800ceaf0 2024-09-21T07:00:54.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.777+0000 7fcb84a7e640 1 -- 172.21.15.63:0/1849559686 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb800d0270 con 0x7fcb800ceaf0 2024-09-21T07:00:54.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.778+0000 7fcb6effd640 1 -- 172.21.15.63:0/1849559686 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcb74041030 con 0x7fcb800ceaf0 2024-09-21T07:00:54.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.778+0000 7fcb6effd640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcb60078b90 0x7fcb6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:54.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.778+0000 7fcb6effd640 1 -- 172.21.15.63:0/1849559686 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7fcb740bb950 con 0x7fcb800ceaf0 2024-09-21T07:00:54.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.778+0000 7fcb7e59c640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcb60078b90 0x7fcb6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:54.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.779+0000 7fcb7e59c640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcb60078b90 0x7fcb6007b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000bb30 tx=0x7fcb7000b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:54.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.783+0000 7fcb6effd640 1 -- 172.21.15.63:0/1849559686 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fcb74083660 con 0x7fcb800ceaf0 2024-09-21T07:00:54.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:54.969+0000 7fcb84a7e640 1 -- 172.21.15.63:0/1849559686 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcb800b8380 con 0x7fcb800ceaf0 2024-09-21T07:00:55.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.726+0000 7fcb6effd640 1 -- 172.21.15.63:0/1849559686 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7fcb74088090 con 0x7fcb800ceaf0 2024-09-21T07:00:55.728 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:00:55.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.732+0000 7fcb84a7e640 1 -- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcb60078b90 msgr2=0x7fcb6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:55.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.732+0000 7fcb84a7e640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcb60078b90 0x7fcb6007b0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000bb30 tx=0x7fcb7000b2e0 comp rx=0 tx=0).stop 2024-09-21T07:00:55.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.732+0000 7fcb84a7e640 1 -- 172.21.15.63:0/1849559686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb800ceaf0 msgr2=0x7fcb8015d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:55.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.732+0000 7fcb84a7e640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb800ceaf0 0x7fcb8015d9e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcb74034040 tx=0x7fcb740038a0 comp rx=0 tx=0).stop 2024-09-21T07:00:55.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.732+0000 7fcb84a7e640 1 -- 172.21.15.63:0/1849559686 shutdown_connections 2024-09-21T07:00:55.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.732+0000 7fcb84a7e640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fcb60078b90 0x7fcb6007b0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:55.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.732+0000 7fcb84a7e640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fcb800d07b0 0x7fcb8006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:55.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.732+0000 7fcb84a7e640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb800ceaf0 0x7fcb8015d9e0 secure :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcb74034040 tx=0x7fcb740038a0 comp rx=0 tx=0).stop 2024-09-21T07:00:55.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.732+0000 7fcb84a7e640 1 --2- 172.21.15.63:0/1849559686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcb800cd580 0x7fcb80151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:55.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.732+0000 7fcb84a7e640 1 -- 172.21.15.63:0/1849559686 >> 172.21.15.63:0/1849559686 conn(0x7fcb800cef40 msgr2=0x7fcb800712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:55.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.733+0000 7fcb84a7e640 1 -- 172.21.15.63:0/1849559686 shutdown_connections 2024-09-21T07:00:55.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.733+0000 7fcb84a7e640 1 -- 172.21.15.63:0/1849559686 wait complete. 2024-09-21T07:00:55.752 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:00:55.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.877+0000 7f3cf4b82640 1 -- 172.21.15.63:0/3850377688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc004800 msgr2=0x7f3cdc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:55.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.877+0000 7f3cf4b82640 1 --2- 172.21.15.63:0/3850377688 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc004800 0x7f3cdc004c10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009b10 tx=0x7f3cdc005830 comp rx=0 tx=0).stop 2024-09-21T07:00:55.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.877+0000 7f3ceed9d640 1 -- 172.21.15.63:0/3850377688 reap_dead start 2024-09-21T07:00:55.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.877+0000 7f3cf4b82640 1 -- 172.21.15.63:0/3850377688 shutdown_connections 2024-09-21T07:00:55.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.877+0000 7f3cf4b82640 1 -- 172.21.15.63:0/3850377688 >> 172.21.15.63:0/3850377688 conn(0x7f3cf00d4680 msgr2=0x7f3cf00d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:55.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.877+0000 7f3cf4b82640 1 -- 172.21.15.63:0/3850377688 shutdown_connections 2024-09-21T07:00:55.880 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.877+0000 7f3cf4b82640 1 -- 172.21.15.63:0/3850377688 wait complete. 2024-09-21T07:00:55.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.879+0000 7f3cf4b82640 1 Processor -- start 2024-09-21T07:00:55.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.879+0000 7f3cf4b82640 1 -- start start 2024-09-21T07:00:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cf4b82640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc004800 0x7f3cf01eb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cf4b82640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf00a1bb0 0x7f3cf00a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cf4b82640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3cf00cd5e0 0x7f3cf00cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cf4b82640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf00d1f40 con 0x7f3cdc004800 2024-09-21T07:00:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cf4b82640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf00d1dc0 con 0x7f3cf00a1bb0 2024-09-21T07:00:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cf4b82640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf00d1770 con 0x7f3cf00cd5e0 2024-09-21T07:00:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cee59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc004800 0x7f3cf01eb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cee59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc004800 0x7f3cf01eb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45616/0 (socket says 172.21.15.63:45616) 2024-09-21T07:00:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cee59c640 1 -- 172.21.15.63:0/2677893125 learned_addr learned my addr 172.21.15.63:0/2677893125 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3ce7fff640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf00a1bb0 0x7f3cf00a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3ceed9d640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3cf00cd5e0 0x7f3cf00cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:55.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cee59c640 1 -- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3cf00cd5e0 msgr2=0x7f3cf00cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:55.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cee59c640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3cf00cd5e0 0x7f3cf00cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:55.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cee59c640 1 -- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf00a1bb0 msgr2=0x7f3cf00a1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:55.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cee59c640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf00a1bb0 0x7f3cf00a1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:55.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cee59c640 1 -- 172.21.15.63:0/2677893125 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf0151580 con 0x7f3cdc004800 2024-09-21T07:00:55.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3ce7fff640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf00a1bb0 0x7f3cf00a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:55.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cee59c640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc004800 0x7f3cf01eb1b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00064a0 tx=0x7f3ce00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:55.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3ce6ffd640 1 -- 172.21.15.63:0/2677893125 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0015070 con 0x7f3cdc004800 2024-09-21T07:00:55.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3ce6ffd640 1 -- 172.21.15.63:0/2677893125 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ce0011860 con 0x7f3cdc004800 2024-09-21T07:00:55.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3cf4b82640 1 -- 172.21.15.63:0/2677893125 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf00cdf30 con 0x7f3cdc004800 2024-09-21T07:00:55.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.881+0000 7f3ce6ffd640 1 -- 172.21.15.63:0/2677893125 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0011cb0 con 0x7f3cdc004800 2024-09-21T07:00:55.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.882+0000 7f3cf4b82640 1 -- 172.21.15.63:0/2677893125 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf0150a00 con 0x7f3cdc004800 2024-09-21T07:00:55.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.883+0000 7f3cf4b82640 1 -- 172.21.15.63:0/2677893125 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf00b9cd0 con 0x7f3cdc004800 2024-09-21T07:00:55.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.883+0000 7f3ce6ffd640 1 -- 172.21.15.63:0/2677893125 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ce0018070 con 0x7f3cdc004800 2024-09-21T07:00:55.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.884+0000 7f3ce6ffd640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3cd0078b90 0x7f3cd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:55.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.884+0000 7f3ce6ffd640 1 -- 172.21.15.63:0/2677893125 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5357+0+0 (secure 0 0 0) 0x7f3ce009ba20 con 0x7f3cdc004800 2024-09-21T07:00:55.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.884+0000 7f3ce7fff640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3cd0078b90 0x7f3cd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:55.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.885+0000 7f3ce7fff640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3cd0078b90 0x7f3cd007b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8035000 tx=0x7f3cd80046c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:55.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:55.888+0000 7f3ce6ffd640 1 -- 172.21.15.63:0/2677893125 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3cf00cdf30 con 0x7f3cdc004800 2024-09-21T07:00:56.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.074+0000 7f3cf4b82640 1 -- 172.21.15.63:0/2677893125 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3cf008e720 con 0x7f3cdc004800 2024-09-21T07:00:56.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.733+0000 7f3ce6ffd640 1 -- 172.21.15.63:0/2677893125 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f3cf00d2e40 con 0x7f3cdc004800 2024-09-21T07:00:56.735 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2024-09-21T07:00:56.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.736+0000 7f3cf4b82640 1 -- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3cd0078b90 msgr2=0x7f3cd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:56.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.736+0000 7f3cf4b82640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3cd0078b90 0x7f3cd007b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8035000 tx=0x7f3cd80046c0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.736+0000 7f3cf4b82640 1 -- 172.21.15.63:0/2677893125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc004800 msgr2=0x7f3cf01eb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:56.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.736+0000 7f3cf4b82640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc004800 0x7f3cf01eb1b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00064a0 tx=0x7f3ce00039c0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.736+0000 7f3cf4b82640 1 -- 172.21.15.63:0/2677893125 shutdown_connections 2024-09-21T07:00:56.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.736+0000 7f3cf4b82640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3cd0078b90 0x7f3cd007b0a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.736+0000 7f3cf4b82640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3cf00cd5e0 0x7f3cf00cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.736+0000 7f3cf4b82640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cf00a1bb0 0x7f3cf00a1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.736+0000 7f3cf4b82640 1 --2- 172.21.15.63:0/2677893125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3cdc004800 0x7f3cf01eb1b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.736+0000 7f3cf4b82640 1 -- 172.21.15.63:0/2677893125 >> 172.21.15.63:0/2677893125 conn(0x7f3cf00d4680 msgr2=0x7f3cf01618e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.736+0000 7f3cf4b82640 1 -- 172.21.15.63:0/2677893125 shutdown_connections 2024-09-21T07:00:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.736+0000 7f3cf4b82640 1 -- 172.21.15.63:0/2677893125 wait complete. 2024-09-21T07:00:56.754 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-21T07:00:56.754 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-21T07:00:56.754 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:00:56.755 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:00:56.755 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-21T07:00:56.755 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-21T07:00:56.755 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:00:56.755 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:00:56.755 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-21T07:00:56.755 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-21T07:00:56.756 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:00:56.756 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:00:56.756 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-21T07:00:56.756 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-21T07:00:56.756 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:00:56.756 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:00:56.766 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:00:56.766 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-21T07:00:56.767 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:00:56.767 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-21T07:00:56.767 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:00:56.768 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-21T07:00:56.770 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:00:56.770 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-21T07:00:56.808 INFO:tasks.ceph.mds.a:Started 2024-09-21T07:00:56.808 DEBUG:teuthology.parallel:result is None 2024-09-21T07:00:56.809 INFO:tasks.ceph.mds.c:Started 2024-09-21T07:00:56.809 DEBUG:teuthology.parallel:result is None 2024-09-21T07:00:56.812 INFO:tasks.ceph.mds.d:Started 2024-09-21T07:00:56.812 DEBUG:teuthology.parallel:result is None 2024-09-21T07:00:56.813 INFO:tasks.ceph.mds.b:Started 2024-09-21T07:00:56.814 DEBUG:teuthology.parallel:result is None 2024-09-21T07:00:56.814 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-21T07:00:56.901 INFO:tasks.ceph.mds.c.smithi063.stdout:starting mds.c at 2024-09-21T07:00:56.902 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2024-09-21T07:00:56.902 INFO:tasks.ceph.mds.d.smithi071.stdout:starting mds.d at 2024-09-21T07:00:56.902 INFO:tasks.ceph.mds.b.smithi071.stdout:starting mds.b at 2024-09-21T07:00:56.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.940+0000 7fd910bda640 1 -- 172.21.15.63:0/3102602728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0cfb80 msgr2=0x7fd90c0b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:56.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.940+0000 7fd910bda640 1 --2- 172.21.15.63:0/3102602728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0cfb80 0x7fd90c0b0b70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd90c09f5a0 tx=0x7fd90402aa50 comp rx=0 tx=0).stop 2024-09-21T07:00:56.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.940+0000 7fd910bda640 1 -- 172.21.15.63:0/3102602728 shutdown_connections 2024-09-21T07:00:56.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.940+0000 7fd910bda640 1 --2- 172.21.15.63:0/3102602728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0cfb80 0x7fd90c0b0b70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.940+0000 7fd910bda640 1 --2- 172.21.15.63:0/3102602728 >> v2:172.21.15.71:3300/0 conn(0x7fd90c0b27a0 0x7fd90c0cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.940+0000 7fd910bda640 1 -- 172.21.15.63:0/3102602728 >> 172.21.15.63:0/3102602728 conn(0x7fd90c0b2f70 msgr2=0x7fd90c0b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:56.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.940+0000 7fd910bda640 1 -- 172.21.15.63:0/3102602728 shutdown_connections 2024-09-21T07:00:56.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.940+0000 7fd910bda640 1 -- 172.21.15.63:0/3102602728 wait complete. 2024-09-21T07:00:56.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.942+0000 7fd910bda640 1 Processor -- start 2024-09-21T07:00:56.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.942+0000 7fd910bda640 1 -- start start 2024-09-21T07:00:56.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.943+0000 7fd910bda640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd90c0b27a0 0x7fd90c0cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:56.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.943+0000 7fd910bda640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0c61e0 0x7fd90c15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:56.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.943+0000 7fd910bda640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd90c0cfb80 0x7fd90c1f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:56.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.943+0000 7fd910bda640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c0b1440 con 0x7fd90c0c61e0 2024-09-21T07:00:56.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.943+0000 7fd910bda640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd90c0b12c0 con 0x7fd90c0b27a0 2024-09-21T07:00:56.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.943+0000 7fd910bda640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd90c0b15c0 con 0x7fd90c0cfb80 2024-09-21T07:00:56.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.943+0000 7fd909d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0c61e0 0x7fd90c15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd909d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0c61e0 0x7fd90c15acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45670/0 (socket says 172.21.15.63:45670) 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd909d9b640 1 -- 172.21.15.63:0/3579453822 learned_addr learned my addr 172.21.15.63:0/3579453822 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd90ad9d640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd90c0cfb80 0x7fd90c1f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd90a59c640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd90c0b27a0 0x7fd90c0cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd909d9b640 1 -- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd90c0cfb80 msgr2=0x7fd90c1f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd909d9b640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd90c0cfb80 0x7fd90c1f5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd909d9b640 1 -- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd90c0b27a0 msgr2=0x7fd90c0cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd909d9b640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd90c0b27a0 0x7fd90c0cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd909d9b640 1 -- 172.21.15.63:0/3579453822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c0cb670 con 0x7fd90c0c61e0 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd909d9b640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0c61e0 0x7fd90c15acc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd90000aea0 tx=0x7fd90000af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd8faffd640 1 -- 172.21.15.63:0/3579453822 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900004230 con 0x7fd90c0c61e0 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd910bda640 1 -- 172.21.15.63:0/3579453822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90c0b02a0 con 0x7fd90c0c61e0 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd8faffd640 1 -- 172.21.15.63:0/3579453822 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9000079b0 con 0x7fd90c0c61e0 2024-09-21T07:00:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd8faffd640 1 -- 172.21.15.63:0/3579453822 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9000044c0 con 0x7fd90c0c61e0 2024-09-21T07:00:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.944+0000 7fd910bda640 1 -- 172.21.15.63:0/3579453822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd90c15d590 con 0x7fd90c0c61e0 2024-09-21T07:00:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.945+0000 7fd910bda640 1 -- 172.21.15.63:0/3579453822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd90c0b07c0 con 0x7fd90c0c61e0 2024-09-21T07:00:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.946+0000 7fd8faffd640 1 -- 172.21.15.63:0/3579453822 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9000035f0 con 0x7fd90c0c61e0 2024-09-21T07:00:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.947+0000 7fd8faffd640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd8ec078bc0 0x7fd8ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.947+0000 7fd8faffd640 1 -- 172.21.15.63:0/3579453822 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7fd90009cbe0 con 0x7fd90c0c61e0 2024-09-21T07:00:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.947+0000 7fd90a59c640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd8ec078bc0 0x7fd8ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.947+0000 7fd90a59c640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd8ec078bc0 0x7fd8ec07b0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc006fd0 tx=0x7fd8fc009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:56.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:56.951+0000 7fd8faffd640 1 -- 172.21.15.63:0/3579453822 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd90c0b07c0 con 0x7fd90c0c61e0 2024-09-21T07:00:57.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.147+0000 7fd910bda640 1 -- 172.21.15.63:0/3579453822 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd90c0d1db0 con 0x7fd90c0c61e0 2024-09-21T07:00:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.746+0000 7fd8faffd640 1 -- 172.21.15.63:0/3579453822 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7fd900064ce0 con 0x7fd90c0c61e0 2024-09-21T07:00:57.748 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blocklist entries 2024-09-21T07:00:57.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.749+0000 7fd910bda640 1 -- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd8ec078bc0 msgr2=0x7fd8ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:57.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.749+0000 7fd910bda640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd8ec078bc0 0x7fd8ec07b0d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc006fd0 tx=0x7fd8fc009060 comp rx=0 tx=0).stop 2024-09-21T07:00:57.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.749+0000 7fd910bda640 1 -- 172.21.15.63:0/3579453822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0c61e0 msgr2=0x7fd90c15acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:57.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.749+0000 7fd910bda640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0c61e0 0x7fd90c15acc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd90000aea0 tx=0x7fd90000af90 comp rx=0 tx=0).stop 2024-09-21T07:00:57.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.749+0000 7fd910bda640 1 -- 172.21.15.63:0/3579453822 shutdown_connections 2024-09-21T07:00:57.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.749+0000 7fd910bda640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd8ec078bc0 0x7fd8ec07b0d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:57.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.749+0000 7fd910bda640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd90c0cfb80 0x7fd90c1f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:57.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.749+0000 7fd910bda640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd90c0c61e0 0x7fd90c15acc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:57.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.749+0000 7fd910bda640 1 --2- 172.21.15.63:0/3579453822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd90c0b27a0 0x7fd90c0cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:57.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.749+0000 7fd910bda640 1 -- 172.21.15.63:0/3579453822 >> 172.21.15.63:0/3579453822 conn(0x7fd90c0b2f70 msgr2=0x7fd90c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:57.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.750+0000 7fd910bda640 1 -- 172.21.15.63:0/3579453822 shutdown_connections 2024-09-21T07:00:57.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.750+0000 7fd910bda640 1 -- 172.21.15.63:0/3579453822 wait complete. 2024-09-21T07:00:57.764 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-21T07:00:57.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.885+0000 7f3b52171640 1 -- 172.21.15.63:0/3241452442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b4c0b3520 msgr2=0x7f3b4c1620d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.885+0000 7f3b52171640 1 --2- 172.21.15.63:0/3241452442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b4c0b3520 0x7f3b4c1620d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0ba2d0 tx=0x7f3b3c02a4a0 comp rx=0 tx=0).stop 2024-09-21T07:00:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.885+0000 7f3b52171640 1 -- 172.21.15.63:0/3241452442 shutdown_connections 2024-09-21T07:00:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.885+0000 7f3b52171640 1 --2- 172.21.15.63:0/3241452442 >> v2:172.21.15.71:3300/0 conn(0x7f3b4c0cf950 0x7f3b4c0d2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.885+0000 7f3b52171640 1 --2- 172.21.15.63:0/3241452442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b4c0b3520 0x7f3b4c1620d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.885+0000 7f3b52171640 1 -- 172.21.15.63:0/3241452442 >> 172.21.15.63:0/3241452442 conn(0x7f3b4c0d4610 msgr2=0x7f3b4c0d4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.886+0000 7f3b52171640 1 -- 172.21.15.63:0/3241452442 shutdown_connections 2024-09-21T07:00:57.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.886+0000 7f3b52171640 1 -- 172.21.15.63:0/3241452442 wait complete. 2024-09-21T07:00:57.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.887+0000 7f3b52171640 1 Processor -- start 2024-09-21T07:00:57.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.887+0000 7f3b52171640 1 -- start start 2024-09-21T07:00:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b52171640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b4c0b3520 0x7f3b4c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b52171640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b4c0b7460 0x7f3b4c14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b52171640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b4c0cf950 0x7f3b4c0a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b52171640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c0d2e20 con 0x7f3b4c0cf950 2024-09-21T07:00:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b52171640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c0d2ca0 con 0x7f3b4c0b7460 2024-09-21T07:00:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b52171640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3b4c0d2fa0 con 0x7f3b4c0b3520 2024-09-21T07:00:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b4bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b4c0cf950 0x7f3b4c0a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b4bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b4c0cf950 0x7f3b4c0a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45680/0 (socket says 172.21.15.63:45680) 2024-09-21T07:00:57.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b4bfff640 1 -- 172.21.15.63:0/560995827 learned_addr learned my addr 172.21.15.63:0/560995827 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b4affd640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b4c0b7460 0x7f3b4c14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b4b7fe640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b4c0b3520 0x7f3b4c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b4bfff640 1 -- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b4c0b3520 msgr2=0x7f3b4c0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b4bfff640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b4c0b3520 0x7f3b4c0cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b4bfff640 1 -- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b4c0b7460 msgr2=0x7f3b4c14ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b4bfff640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b4c0b7460 0x7f3b4c14ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b4bfff640 1 -- 172.21.15.63:0/560995827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4c14f190 con 0x7f3b4c0cf950 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b4b7fe640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b4c0b3520 0x7f3b4c0cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.889+0000 7f3b4bfff640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b4c0cf950 0x7f3b4c0a0120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400e990 tx=0x7f3b4400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.890+0000 7f3b43fff640 1 -- 172.21.15.63:0/560995827 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44004d20 con 0x7f3b4c0cf950 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.890+0000 7f3b43fff640 1 -- 172.21.15.63:0/560995827 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b4400caa0 con 0x7f3b4c0cf950 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.890+0000 7f3b52171640 1 -- 172.21.15.63:0/560995827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4c0ccb80 con 0x7f3b4c0cf950 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.890+0000 7f3b43fff640 1 -- 172.21.15.63:0/560995827 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44005020 con 0x7f3b4c0cf950 2024-09-21T07:00:57.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.890+0000 7f3b52171640 1 -- 172.21.15.63:0/560995827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b4c0cd140 con 0x7f3b4c0cf950 2024-09-21T07:00:57.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.891+0000 7f3b52171640 1 -- 172.21.15.63:0/560995827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b4c0d3450 con 0x7f3b4c0cf950 2024-09-21T07:00:57.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.891+0000 7f3b43fff640 1 -- 172.21.15.63:0/560995827 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3b440051c0 con 0x7f3b4c0cf950 2024-09-21T07:00:57.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.892+0000 7f3b43fff640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3b2c078bc0 0x7f3b2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:57.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.892+0000 7f3b43fff640 1 -- 172.21.15.63:0/560995827 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f3b4409b1b0 con 0x7f3b4c0cf950 2024-09-21T07:00:57.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.892+0000 7f3b4b7fe640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3b2c078bc0 0x7f3b2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:57.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.893+0000 7f3b4b7fe640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3b2c078bc0 0x7f3b2c07b0d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b34007fd0 tx=0x7f3b34009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:57.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:57.897+0000 7f3b43fff640 1 -- 172.21.15.63:0/560995827 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3b44016030 con 0x7f3b4c0cf950 2024-09-21T07:00:58.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.154+0000 7f3b52171640 1 -- 172.21.15.63:0/560995827 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f3b4c0a0e20 con 0x7f3b4c0cf950 2024-09-21T07:00:58.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.155+0000 7f3b43fff640 1 -- 172.21.15.63:0/560995827 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7f3b44063380 con 0x7f3b4c0cf950 2024-09-21T07:00:58.156 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:00:58.157 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T07:00:58.157 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2024-09-21T07:00:58.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.157 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2024-09-21T07:00:58.157 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDIbu5meVd6ERAANGtaz6BkYKbchfRjvIjleQ==", 2024-09-21T07:00:58.157 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.157 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-21T07:00:58.157 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-09-21T07:00:58.157 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-09-21T07:00:58.157 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.157 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.157 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.157 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDIbu5mAC26HhAAp2txhZwvIUr/+F6PI1X9qQ==", 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.c", 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDIbu5mSHBNGRAA8Jn8O+btocLR/dYZhMObkA==", 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-21T07:00:58.158 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.d", 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDIbu5mmLxTJhAAzruHU6YrbEHo9Rr27AanZA==", 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.159 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDMbu5mcp3DCxAAkQ7/BGxbj9HZruEL18uXbQ==", 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDPbu5m2sS9HhAAQLSNKB+L11umAFGRU2SdRg==", 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-21T07:00:58.160 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDSbu5mxorjIRAAZpxUa3uAEL4tNaW6s6xbhw==", 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.161 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDVbu5mwH2yMxAAyQmVjMwkvW3wvke3oz1uvA==", 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDcbu5m1RH6ABAA/y6ZIItVPI9n4HAbPGHuFw==", 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.162 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDfbu5mfs1fAxAAreQ3vZikJcCID2ZvVoOwOA==", 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDibu5mbaoLBRAAddJirSFHx4XxXSgc5SZvCg==", 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.163 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDlbu5m0B9NFhAABxA3thk/yIeLC9GVJik6Eg==", 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.164 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDIbu5m2BwLKxAApPnoP3MWVo8VSu4x9i/uCg==", 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDIbu5moBCvMhAAggkJHqcJoA6e7GjiKD5atA==", 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2024-09-21T07:00:58.165 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDIbu5mpc7oLhAAwoG0LEhpxmtQpA4+1CwCqA==", 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.166 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDIbu5mKWNkNhAAIo/VPx0qINR34qhkIOPC9Q==", 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDHbu5mK1pHLhAACe7DcM7djKaeifa3T6Aj7w==", 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2024-09-21T07:00:58.167 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-mds", 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDsbu5mjhDoDBAAgbvEbN0Z+4Hx8qMintEXFA==", 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-mds" 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-mgr", 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDsbu5mhBnoDBAAsNH02qq/6b5lWBoF1xQdFw==", 2024-09-21T07:00:58.168 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-osd", 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDsbu5mySXoDBAAHRCoH38bywewFhpA7PQBog==", 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-osd" 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rbd", 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDsbu5mbi3oDBAAmokEamTIPSRvyWqDyGLwqQ==", 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.169 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDsbu5mFzXoDBAAmuHW9JNWuXLEujaEKwWNBQ==", 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rgw", 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDsbu5mJz3oDBAAGpnicUhFx/pCnAihmKPlwg==", 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.170 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDIbu5mXZ6TDRAAW9ePEsTLEIIc5GKFurGB2A==", 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2024-09-21T07:00:58.171 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQDIbu5mR9WaCBAAQrOhRcZdJy77nbiwIIpNzA==", 2024-09-21T07:00:58.172 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2024-09-21T07:00:58.172 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2024-09-21T07:00:58.172 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2024-09-21T07:00:58.172 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2024-09-21T07:00:58.172 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.172 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:00:58.172 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2024-09-21T07:00:58.172 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T07:00:58.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.157+0000 7f3b52171640 1 -- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3b2c078bc0 msgr2=0x7f3b2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.157+0000 7f3b52171640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3b2c078bc0 0x7f3b2c07b0d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b34007fd0 tx=0x7f3b34009040 comp rx=0 tx=0).stop 2024-09-21T07:00:58.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.157+0000 7f3b52171640 1 -- 172.21.15.63:0/560995827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b4c0cf950 msgr2=0x7f3b4c0a0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.157+0000 7f3b52171640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b4c0cf950 0x7f3b4c0a0120 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400e990 tx=0x7f3b4400ee50 comp rx=0 tx=0).stop 2024-09-21T07:00:58.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.157+0000 7f3b52171640 1 -- 172.21.15.63:0/560995827 shutdown_connections 2024-09-21T07:00:58.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.157+0000 7f3b52171640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3b2c078bc0 0x7f3b2c07b0d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.157+0000 7f3b52171640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b4c0cf950 0x7f3b4c0a0120 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.157+0000 7f3b52171640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b4c0b7460 0x7f3b4c14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.157+0000 7f3b52171640 1 --2- 172.21.15.63:0/560995827 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b4c0b3520 0x7f3b4c0cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.157+0000 7f3b52171640 1 -- 172.21.15.63:0/560995827 >> 172.21.15.63:0/560995827 conn(0x7f3b4c0d4610 msgr2=0x7f3b4c0d1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:58.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.157+0000 7f3b52171640 1 -- 172.21.15.63:0/560995827 shutdown_connections 2024-09-21T07:00:58.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.157+0000 7f3b52171640 1 -- 172.21.15.63:0/560995827 wait complete. 2024-09-21T07:00:58.174 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-21T07:00:58.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.290+0000 7fc1b5dba640 1 -- 172.21.15.63:0/1271784866 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1b006f020 msgr2=0x7fc1b01665d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.290+0000 7fc1b5dba640 1 --2- 172.21.15.63:0/1271784866 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1b006f020 0x7fc1b01665d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009c10 tx=0x7fc1a802a8d0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.290+0000 7fc1b5dba640 1 -- 172.21.15.63:0/1271784866 shutdown_connections 2024-09-21T07:00:58.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.290+0000 7fc1b5dba640 1 --2- 172.21.15.63:0/1271784866 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1b006f020 0x7fc1b01665d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.290+0000 7fc1b5dba640 1 -- 172.21.15.63:0/1271784866 >> 172.21.15.63:0/1271784866 conn(0x7fc1b006d3e0 msgr2=0x7fc1b00b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:58.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.290+0000 7fc1b5dba640 1 -- 172.21.15.63:0/1271784866 shutdown_connections 2024-09-21T07:00:58.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.290+0000 7fc1b5dba640 1 -- 172.21.15.63:0/1271784866 wait complete. 2024-09-21T07:00:58.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.292+0000 7fc1b5dba640 1 Processor -- start 2024-09-21T07:00:58.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.292+0000 7fc1b5dba640 1 -- start start 2024-09-21T07:00:58.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.293+0000 7fc1b5dba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b006f020 0x7fc1b014ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.293+0000 7fc1b5dba640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b0070830 0x7fc1b00b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.293+0000 7fc1b5dba640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1b0155d60 0x7fc1b00994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.293+0000 7fc1b5dba640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b0166f50 con 0x7fc1b0070830 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1b5dba640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b0166dd0 con 0x7fc1b006f020 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1b5dba640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b01670d0 con 0x7fc1b0155d60 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1aeffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b0070830 0x7fc1b00b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1aeffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b0070830 0x7fc1b00b1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45694/0 (socket says 172.21.15.63:45694) 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1aeffd640 1 -- 172.21.15.63:0/3513818541 learned_addr learned my addr 172.21.15.63:0/3513818541 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1af7fe640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b006f020 0x7fc1b014ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1affff640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1b0155d60 0x7fc1b00994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1aeffd640 1 -- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1b0155d60 msgr2=0x7fc1b00994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1aeffd640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1b0155d60 0x7fc1b00994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1aeffd640 1 -- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b006f020 msgr2=0x7fc1b014ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1aeffd640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b006f020 0x7fc1b014ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1aeffd640 1 -- 172.21.15.63:0/3513818541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b00c36c0 con 0x7fc1b0070830 2024-09-21T07:00:58.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1aeffd640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b0070830 0x7fc1b00b1ae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c3c0 tx=0x7fc1a400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:58.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc197fff640 1 -- 172.21.15.63:0/3513818541 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4017070 con 0x7fc1b0070830 2024-09-21T07:00:58.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1b5dba640 1 -- 172.21.15.63:0/3513818541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b00c3100 con 0x7fc1b0070830 2024-09-21T07:00:58.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc197fff640 1 -- 172.21.15.63:0/3513818541 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1a40053c0 con 0x7fc1b0070830 2024-09-21T07:00:58.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc197fff640 1 -- 172.21.15.63:0/3513818541 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4003850 con 0x7fc1b0070830 2024-09-21T07:00:58.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.294+0000 7fc1b5dba640 1 -- 172.21.15.63:0/3513818541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b00c1aa0 con 0x7fc1b0070830 2024-09-21T07:00:58.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.296+0000 7fc1b5dba640 1 -- 172.21.15.63:0/3513818541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b00b2a70 con 0x7fc1b0070830 2024-09-21T07:00:58.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.296+0000 7fc197fff640 1 -- 172.21.15.63:0/3513818541 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc1a401a070 con 0x7fc1b0070830 2024-09-21T07:00:58.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.297+0000 7fc197fff640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc19c078b90 0x7fc19c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.297+0000 7fc197fff640 1 -- 172.21.15.63:0/3513818541 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fc1a4099d10 con 0x7fc1b0070830 2024-09-21T07:00:58.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.297+0000 7fc1af7fe640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc19c078b90 0x7fc19c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.297+0000 7fc1af7fe640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc19c078b90 0x7fc19c07b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0001860 tx=0x7fc1a00016d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:58.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.301+0000 7fc197fff640 1 -- 172.21.15.63:0/3513818541 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc1a4061dd0 con 0x7fc1b0070830 2024-09-21T07:00:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.563+0000 7fc1b5dba640 1 -- 172.21.15.63:0/3513818541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fc1b00ad240 con 0x7fc1b0070830 2024-09-21T07:00:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.565+0000 7fc197fff640 1 -- 172.21.15.63:0/3513818541 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7fc1a4066800 con 0x7fc1b0070830 2024-09-21T07:00:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.568+0000 7fc1b5dba640 1 -- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc19c078b90 msgr2=0x7fc19c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.568+0000 7fc1b5dba640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc19c078b90 0x7fc19c07b0a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0001860 tx=0x7fc1a00016d0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.568+0000 7fc1b5dba640 1 -- 172.21.15.63:0/3513818541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b0070830 msgr2=0x7fc1b00b1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.568+0000 7fc1b5dba640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b0070830 0x7fc1b00b1ae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400c3c0 tx=0x7fc1a400c880 comp rx=0 tx=0).stop 2024-09-21T07:00:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.568+0000 7fc1b5dba640 1 -- 172.21.15.63:0/3513818541 shutdown_connections 2024-09-21T07:00:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.568+0000 7fc1b5dba640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc19c078b90 0x7fc19c07b0a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.568+0000 7fc1b5dba640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc1b0155d60 0x7fc1b00994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.568+0000 7fc1b5dba640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b0070830 0x7fc1b00b1ae0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.568+0000 7fc1b5dba640 1 --2- 172.21.15.63:0/3513818541 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1b006f020 0x7fc1b014ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.568+0000 7fc1b5dba640 1 -- 172.21.15.63:0/3513818541 >> 172.21.15.63:0/3513818541 conn(0x7fc1b006d3e0 msgr2=0x7fc1b00cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.568+0000 7fc1b5dba640 1 -- 172.21.15.63:0/3513818541 shutdown_connections 2024-09-21T07:00:58.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.568+0000 7fc1b5dba640 1 -- 172.21.15.63:0/3513818541 wait complete. 2024-09-21T07:00:58.581 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-21T07:00:58.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.696+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/2138796183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415f940 msgr2=0x7f3c241655c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.696+0000 7f3c2b3f1640 1 --2- 172.21.15.63:0/2138796183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415f940 0x7f3c241655c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c005fd0 tx=0x7f3c1c02a940 comp rx=0 tx=0).stop 2024-09-21T07:00:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.696+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/2138796183 shutdown_connections 2024-09-21T07:00:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.696+0000 7f3c2b3f1640 1 --2- 172.21.15.63:0/2138796183 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c2415f940 0x7f3c241655c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.696+0000 7f3c2b3f1640 1 --2- 172.21.15.63:0/2138796183 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3c24155d60 0x7f3c2406f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.696+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/2138796183 >> 172.21.15.63:0/2138796183 conn(0x7f3c2406d3e0 msgr2=0x7f3c240b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.697+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/2138796183 shutdown_connections 2024-09-21T07:00:58.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.697+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/2138796183 wait complete. 2024-09-21T07:00:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.698+0000 7f3c2b3f1640 1 Processor -- start 2024-09-21T07:00:58.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.698+0000 7f3c2b3f1640 1 -- start start 2024-09-21T07:00:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2b3f1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3c24070830 0x7f3c2415de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2b3f1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c24155d60 0x7f3c2415e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2b3f1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c2415f940 0x7f3c241f8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2b3f1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3c24165d10 con 0x7f3c24155d60 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2b3f1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3c24160050 con 0x7f3c2415f940 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2b3f1640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3c24165e90 con 0x7f3c24070830 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2898c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c24155d60 0x7f3c2415e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2898c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c24155d60 0x7f3c2415e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38806/0 (socket says 172.21.15.63:38806) 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2898c640 1 -- 172.21.15.63:0/974982500 learned_addr learned my addr 172.21.15.63:0/974982500 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2998e640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c2415f940 0x7f3c241f8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2918d640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3c24070830 0x7f3c2415de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2898c640 1 -- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3c24070830 msgr2=0x7f3c2415de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2898c640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3c24070830 0x7f3c2415de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2898c640 1 -- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c2415f940 msgr2=0x7f3c241f8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2898c640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c2415f940 0x7f3c241f8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2898c640 1 -- 172.21.15.63:0/974982500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c240c6cf0 con 0x7f3c24155d60 2024-09-21T07:00:58.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.700+0000 7f3c2898c640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c24155d60 0x7f3c2415e370 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400e7c0 tx=0x7f3c1400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.701+0000 7f3c19ffb640 1 -- 172.21.15.63:0/974982500 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1400cc60 con 0x7f3c24155d60 2024-09-21T07:00:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.701+0000 7f3c19ffb640 1 -- 172.21.15.63:0/974982500 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c14010430 con 0x7f3c24155d60 2024-09-21T07:00:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.701+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/974982500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2415e8b0 con 0x7f3c24155d60 2024-09-21T07:00:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.701+0000 7f3c19ffb640 1 -- 172.21.15.63:0/974982500 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14010860 con 0x7f3c24155d60 2024-09-21T07:00:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.701+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/974982500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c2415eb70 con 0x7f3c24155d60 2024-09-21T07:00:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.702+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/974982500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c2406f020 con 0x7f3c24155d60 2024-09-21T07:00:58.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.703+0000 7f3c19ffb640 1 -- 172.21.15.63:0/974982500 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3c14010a00 con 0x7f3c24155d60 2024-09-21T07:00:58.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.703+0000 7f3c19ffb640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3c08078bc0 0x7f3c0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:58.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.703+0000 7f3c19ffb640 1 -- 172.21.15.63:0/974982500 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f3c1409b380 con 0x7f3c24155d60 2024-09-21T07:00:58.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.703+0000 7f3c2918d640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3c08078bc0 0x7f3c0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:58.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.704+0000 7f3c2918d640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3c08078bc0 0x7f3c0807b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3c20000f60 tx=0x7f3c20009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:58.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.708+0000 7f3c19ffb640 1 -- 172.21.15.63:0/974982500 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3c14063440 con 0x7f3c24155d60 2024-09-21T07:00:58.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.970+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/974982500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f3c240c47b0 con 0x7f3c24155d60 2024-09-21T07:00:58.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.973+0000 7f3c19ffb640 1 -- 172.21.15.63:0/974982500 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f3c14067e70 con 0x7f3c24155d60 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.975+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3c08078bc0 msgr2=0x7f3c0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.975+0000 7f3c2b3f1640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3c08078bc0 0x7f3c0807b0d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3c20000f60 tx=0x7f3c20009040 comp rx=0 tx=0).stop 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.975+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/974982500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c24155d60 msgr2=0x7f3c2415e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.975+0000 7f3c2b3f1640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c24155d60 0x7f3c2415e370 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400e7c0 tx=0x7f3c1400ec80 comp rx=0 tx=0).stop 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.975+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/974982500 shutdown_connections 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.975+0000 7f3c2b3f1640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3c08078bc0 0x7f3c0807b0d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.975+0000 7f3c2b3f1640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c2415f940 0x7f3c241f8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.975+0000 7f3c2b3f1640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c24155d60 0x7f3c2415e370 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.975+0000 7f3c2b3f1640 1 --2- 172.21.15.63:0/974982500 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3c24070830 0x7f3c2415de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.975+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/974982500 >> 172.21.15.63:0/974982500 conn(0x7f3c2406d3e0 msgr2=0x7f3c24164610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.975+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/974982500 shutdown_connections 2024-09-21T07:00:58.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:58.975+0000 7f3c2b3f1640 1 -- 172.21.15.63:0/974982500 wait complete. 2024-09-21T07:00:58.988 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-21T07:00:59.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.104+0000 7f0ecd382640 1 -- 172.21.15.63:0/814085594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40053a0 msgr2=0x7f0eb400ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.104+0000 7f0ecd382640 1 --2- 172.21.15.63:0/814085594 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40053a0 0x7f0eb400ba20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8006af0 tx=0x7f0eb4005830 comp rx=0 tx=0).stop 2024-09-21T07:00:59.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.104+0000 7f0ec77fe640 1 -- 172.21.15.63:0/814085594 reap_dead start 2024-09-21T07:00:59.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.104+0000 7f0ecd382640 1 -- 172.21.15.63:0/814085594 shutdown_connections 2024-09-21T07:00:59.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.104+0000 7f0ecd382640 1 -- 172.21.15.63:0/814085594 >> 172.21.15.63:0/814085594 conn(0x7f0ec80ceec0 msgr2=0x7f0ec80cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:59.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.104+0000 7f0ecd382640 1 -- 172.21.15.63:0/814085594 shutdown_connections 2024-09-21T07:00:59.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.104+0000 7f0ecd382640 1 -- 172.21.15.63:0/814085594 wait complete. 2024-09-21T07:00:59.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.106+0000 7f0ecd382640 1 Processor -- start 2024-09-21T07:00:59.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.106+0000 7f0ecd382640 1 -- start start 2024-09-21T07:00:59.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.107+0000 7f0ecd382640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eb40053a0 0x7f0ec81f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:59.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.107+0000 7f0ecd382640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec80c5f70 0x7f0ec80c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:59.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.107+0000 7f0ecd382640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ec80afea0 0x7f0ec80b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:59.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.107+0000 7f0ecd382640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec80af5c0 con 0x7f0ec80c5f70 2024-09-21T07:00:59.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.107+0000 7f0ecd382640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec80d2290 con 0x7f0eb40053a0 2024-09-21T07:00:59.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.107+0000 7f0ecd382640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0ec80af740 con 0x7f0ec80afea0 2024-09-21T07:00:59.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ec67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec80c5f70 0x7f0ec80c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ec67fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec80c5f70 0x7f0ec80c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38830/0 (socket says 172.21.15.63:38830) 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ec67fc640 1 -- 172.21.15.63:0/3754353567 learned_addr learned my addr 172.21.15.63:0/3754353567 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ec6ffd640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eb40053a0 0x7f0ec81f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ec77fe640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ec80afea0 0x7f0ec80b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ec67fc640 1 -- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ec80afea0 msgr2=0x7f0ec80b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ec67fc640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ec80afea0 0x7f0ec80b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ec67fc640 1 -- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eb40053a0 msgr2=0x7f0ec81f4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ec67fc640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eb40053a0 0x7f0ec81f4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ec67fc640 1 -- 172.21.15.63:0/3754353567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec80b07f0 con 0x7f0ec80c5f70 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ec67fc640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec80c5f70 0x7f0ec80c6380 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0011a30 tx=0x7f0eb0011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ebf7fe640 1 -- 172.21.15.63:0/3754353567 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb001f070 con 0x7f0ec80c5f70 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ebf7fe640 1 -- 172.21.15.63:0/3754353567 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0eb000fe20 con 0x7f0ec80c5f70 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ecd382640 1 -- 172.21.15.63:0/3754353567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec81e7620 con 0x7f0ec80c5f70 2024-09-21T07:00:59.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ebf7fe640 1 -- 172.21.15.63:0/3754353567 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00126b0 con 0x7f0ec80c5f70 2024-09-21T07:00:59.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.108+0000 7f0ecd382640 1 -- 172.21.15.63:0/3754353567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec81f3c60 con 0x7f0ec80c5f70 2024-09-21T07:00:59.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.109+0000 7f0ecd382640 1 -- 172.21.15.63:0/3754353567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec80b7890 con 0x7f0ec80c5f70 2024-09-21T07:00:59.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.110+0000 7f0ebf7fe640 1 -- 172.21.15.63:0/3754353567 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0eb0022070 con 0x7f0ec80c5f70 2024-09-21T07:00:59.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.111+0000 7f0ebf7fe640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0ea8078b90 0x7f0ea807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:59.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.111+0000 7f0ebf7fe640 1 -- 172.21.15.63:0/3754353567 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f0eb009b520 con 0x7f0ec80c5f70 2024-09-21T07:00:59.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.111+0000 7f0ec6ffd640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0ea8078b90 0x7f0ea807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:59.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.112+0000 7f0ec6ffd640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0ea8078b90 0x7f0ea807b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0001590 tx=0x7f0ec00013e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:59.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.115+0000 7f0ebf7fe640 1 -- 172.21.15.63:0/3754353567 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0ec80b07f0 con 0x7f0ec80c5f70 2024-09-21T07:00:59.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.380+0000 7f0ecd382640 1 -- 172.21.15.63:0/3754353567 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f0ec8076ac0 con 0x7f0ec80c5f70 2024-09-21T07:00:59.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.383+0000 7f0ebf7fe640 1 -- 172.21.15.63:0/3754353567 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f0eb0063670 con 0x7f0ec80c5f70 2024-09-21T07:00:59.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.386+0000 7f0ecd382640 1 -- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0ea8078b90 msgr2=0x7f0ea807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.386+0000 7f0ecd382640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0ea8078b90 0x7f0ea807b0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0001590 tx=0x7f0ec00013e0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.386+0000 7f0ecd382640 1 -- 172.21.15.63:0/3754353567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec80c5f70 msgr2=0x7f0ec80c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.386+0000 7f0ecd382640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec80c5f70 0x7f0ec80c6380 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0011a30 tx=0x7f0eb0011ef0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.386+0000 7f0ecd382640 1 -- 172.21.15.63:0/3754353567 shutdown_connections 2024-09-21T07:00:59.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.386+0000 7f0ecd382640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0ea8078b90 0x7f0ea807b0a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.386+0000 7f0ecd382640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ec80afea0 0x7f0ec80b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.386+0000 7f0ecd382640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ec80c5f70 0x7f0ec80c6380 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.386+0000 7f0ecd382640 1 --2- 172.21.15.63:0/3754353567 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0eb40053a0 0x7f0ec81f4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.386+0000 7f0ecd382640 1 -- 172.21.15.63:0/3754353567 >> 172.21.15.63:0/3754353567 conn(0x7f0ec80ceec0 msgr2=0x7f0ec8072180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:59.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.386+0000 7f0ecd382640 1 -- 172.21.15.63:0/3754353567 shutdown_connections 2024-09-21T07:00:59.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.386+0000 7f0ecd382640 1 -- 172.21.15.63:0/3754353567 wait complete. 2024-09-21T07:00:59.399 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-21T07:00:59.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.515+0000 7fd8edfe6640 1 -- 172.21.15.63:0/1956175837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e815ef00 msgr2=0x7fd8e80d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.515+0000 7fd8edfe6640 1 --2- 172.21.15.63:0/1956175837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e815ef00 0x7fd8e80d2c40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80ba3a0 tx=0x7fd8dc02a560 comp rx=0 tx=0).stop 2024-09-21T07:00:59.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.515+0000 7fd8edfe6640 1 -- 172.21.15.63:0/1956175837 shutdown_connections 2024-09-21T07:00:59.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.515+0000 7fd8edfe6640 1 --2- 172.21.15.63:0/1956175837 >> v2:172.21.15.71:3300/0 conn(0x7fd8e80cf310 0x7fd8e80cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.515+0000 7fd8edfe6640 1 --2- 172.21.15.63:0/1956175837 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e815ef00 0x7fd8e80d2c40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.515+0000 7fd8edfe6640 1 -- 172.21.15.63:0/1956175837 >> 172.21.15.63:0/1956175837 conn(0x7fd8e808bfd0 msgr2=0x7fd8e80d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:59.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.515+0000 7fd8edfe6640 1 -- 172.21.15.63:0/1956175837 shutdown_connections 2024-09-21T07:00:59.517 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.515+0000 7fd8edfe6640 1 -- 172.21.15.63:0/1956175837 wait complete. 2024-09-21T07:00:59.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.517+0000 7fd8edfe6640 1 Processor -- start 2024-09-21T07:00:59.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.517+0000 7fd8edfe6640 1 -- start start 2024-09-21T07:00:59.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.518+0000 7fd8edfe6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e80b7530 0x7fd8e815f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:59.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.518+0000 7fd8edfe6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e80cf310 0x7fd8e80ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:59.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.518+0000 7fd8edfe6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8e815ef00 0x7fd8e81f9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:59.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.518+0000 7fd8edfe6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e80cfff0 con 0x7fd8e80cf310 2024-09-21T07:00:59.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.518+0000 7fd8edfe6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e80cfe70 con 0x7fd8e815ef00 2024-09-21T07:00:59.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.518+0000 7fd8edfe6640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e80d0170 con 0x7fd8e80b7530 2024-09-21T07:00:59.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.518+0000 7fd8e6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e80cf310 0x7fd8e80ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:59.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.518+0000 7fd8e6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e80cf310 0x7fd8e80ca0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38844/0 (socket says 172.21.15.63:38844) 2024-09-21T07:00:59.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.518+0000 7fd8e6ffd640 1 -- 172.21.15.63:0/17285731 learned_addr learned my addr 172.21.15.63:0/17285731 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:59.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.518+0000 7fd8e7fff640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8e815ef00 0x7fd8e81f9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:59.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.518+0000 7fd8e77fe640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e80b7530 0x7fd8e815f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:59.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.518+0000 7fd8e6ffd640 1 -- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e80b7530 msgr2=0x7fd8e815f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.518+0000 7fd8e6ffd640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e80b7530 0x7fd8e815f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.519+0000 7fd8e6ffd640 1 -- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8e815ef00 msgr2=0x7fd8e81f9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.519+0000 7fd8e6ffd640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8e815ef00 0x7fd8e81f9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.519+0000 7fd8e6ffd640 1 -- 172.21.15.63:0/17285731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e80cba00 con 0x7fd8e80cf310 2024-09-21T07:00:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.519+0000 7fd8e7fff640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8e815ef00 0x7fd8e81f9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:00:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.519+0000 7fd8e6ffd640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e80cf310 0x7fd8e80ca0e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0099c0 tx=0x7fd8dc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.519+0000 7fd8cffff640 1 -- 172.21.15.63:0/17285731 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc03e030 con 0x7fd8e80cf310 2024-09-21T07:00:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.519+0000 7fd8cffff640 1 -- 172.21.15.63:0/17285731 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8dc0047a0 con 0x7fd8e80cf310 2024-09-21T07:00:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.519+0000 7fd8cffff640 1 -- 172.21.15.63:0/17285731 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc035040 con 0x7fd8e80cf310 2024-09-21T07:00:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.519+0000 7fd8edfe6640 1 -- 172.21.15.63:0/17285731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e80cddf0 con 0x7fd8e80cf310 2024-09-21T07:00:59.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.519+0000 7fd8edfe6640 1 -- 172.21.15.63:0/17285731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e80ce3b0 con 0x7fd8e80cf310 2024-09-21T07:00:59.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.520+0000 7fd8edfe6640 1 -- 172.21.15.63:0/17285731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e80d0670 con 0x7fd8e80cf310 2024-09-21T07:00:59.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.521+0000 7fd8cffff640 1 -- 172.21.15.63:0/17285731 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8dc041030 con 0x7fd8e80cf310 2024-09-21T07:00:59.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.521+0000 7fd8cffff640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd8d4078b90 0x7fd8d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:59.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.521+0000 7fd8cffff640 1 -- 172.21.15.63:0/17285731 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fd8dc0bb230 con 0x7fd8e80cf310 2024-09-21T07:00:59.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.521+0000 7fd8e77fe640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd8d4078b90 0x7fd8d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:59.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.522+0000 7fd8e77fe640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd8d4078b90 0x7fd8d407b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80d4660 tx=0x7fd8d8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:59.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.526+0000 7fd8cffff640 1 -- 172.21.15.63:0/17285731 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd8dc083a50 con 0x7fd8e80cf310 2024-09-21T07:00:59.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.788+0000 7fd8edfe6640 1 -- 172.21.15.63:0/17285731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fd8e806a130 con 0x7fd8e80cf310 2024-09-21T07:00:59.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.790+0000 7fd8cffff640 1 -- 172.21.15.63:0/17285731 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fd8dc083350 con 0x7fd8e80cf310 2024-09-21T07:00:59.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.792+0000 7fd8edfe6640 1 -- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd8d4078b90 msgr2=0x7fd8d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.792+0000 7fd8edfe6640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd8d4078b90 0x7fd8d407b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80d4660 tx=0x7fd8d8008040 comp rx=0 tx=0).stop 2024-09-21T07:00:59.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.792+0000 7fd8edfe6640 1 -- 172.21.15.63:0/17285731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e80cf310 msgr2=0x7fd8e80ca0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.792+0000 7fd8edfe6640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e80cf310 0x7fd8e80ca0e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0099c0 tx=0x7fd8dc0039e0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.793+0000 7fd8edfe6640 1 -- 172.21.15.63:0/17285731 shutdown_connections 2024-09-21T07:00:59.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.793+0000 7fd8edfe6640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd8d4078b90 0x7fd8d407b0a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.793+0000 7fd8edfe6640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8e815ef00 0x7fd8e81f9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.793+0000 7fd8edfe6640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8e80cf310 0x7fd8e80ca0e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.793+0000 7fd8edfe6640 1 --2- 172.21.15.63:0/17285731 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd8e80b7530 0x7fd8e815f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.793+0000 7fd8edfe6640 1 -- 172.21.15.63:0/17285731 >> 172.21.15.63:0/17285731 conn(0x7fd8e808bfd0 msgr2=0x7fd8e815a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:59.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.793+0000 7fd8edfe6640 1 -- 172.21.15.63:0/17285731 shutdown_connections 2024-09-21T07:00:59.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.793+0000 7fd8edfe6640 1 -- 172.21.15.63:0/17285731 wait complete. 2024-09-21T07:00:59.806 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-21T07:00:59.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.921+0000 7f7fab63f640 1 -- 172.21.15.63:0/4066658061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fa40cd0b0 msgr2=0x7f7fa40cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.921+0000 7f7fab63f640 1 --2- 172.21.15.63:0/4066658061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fa40cd0b0 0x7f7fa40cd4c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7f94005fd0 tx=0x7f7f9402a540 comp rx=0 tx=0).stop 2024-09-21T07:00:59.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.921+0000 7f7fab63f640 1 -- 172.21.15.63:0/4066658061 shutdown_connections 2024-09-21T07:00:59.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.921+0000 7f7fab63f640 1 --2- 172.21.15.63:0/4066658061 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fa40cd0b0 0x7f7fa40cd4c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.921+0000 7f7fab63f640 1 --2- 172.21.15.63:0/4066658061 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fa40b52a0 0x7f7fa40b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.921+0000 7f7fab63f640 1 -- 172.21.15.63:0/4066658061 >> 172.21.15.63:0/4066658061 conn(0x7f7fa40ceed0 msgr2=0x7f7fa40cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:00:59.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.921+0000 7f7fab63f640 1 -- 172.21.15.63:0/4066658061 shutdown_connections 2024-09-21T07:00:59.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.921+0000 7f7fab63f640 1 -- 172.21.15.63:0/4066658061 wait complete. 2024-09-21T07:00:59.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.923+0000 7f7fab63f640 1 Processor -- start 2024-09-21T07:00:59.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.923+0000 7f7fab63f640 1 -- start start 2024-09-21T07:00:59.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.924+0000 7f7fab63f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fa40b52a0 0x7f7fa406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:59.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.924+0000 7f7fab63f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fa40cd0b0 0x7f7fa415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:59.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.924+0000 7f7fab63f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fa40d0350 0x7f7fa40af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:59.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.924+0000 7f7fab63f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa40d0760 con 0x7f7fa40b52a0 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.924+0000 7f7fab63f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa4074590 con 0x7f7fa40cd0b0 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.924+0000 7f7fab63f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa40b5bf0 con 0x7f7fa40d0350 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa93db640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fa40b52a0 0x7f7fa406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa93db640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fa40b52a0 0x7f7fa406e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38866/0 (socket says 172.21.15.63:38866) 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa93db640 1 -- 172.21.15.63:0/273322149 learned_addr learned my addr 172.21.15.63:0/273322149 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa8bda640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fa40cd0b0 0x7f7fa415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa9bdc640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fa40d0350 0x7f7fa40af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa93db640 1 -- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fa40d0350 msgr2=0x7f7fa40af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa93db640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fa40d0350 0x7f7fa40af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa93db640 1 -- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fa40cd0b0 msgr2=0x7f7fa415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa93db640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fa40cd0b0 0x7f7fa415a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa93db640 1 -- 172.21.15.63:0/273322149 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa40b0720 con 0x7f7fa40b52a0 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa93db640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fa40b52a0 0x7f7fa406e8d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c390 tx=0x7f7f9c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:59.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa1ffb640 1 -- 172.21.15.63:0/273322149 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c017070 con 0x7f7fa40b52a0 2024-09-21T07:00:59.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa1ffb640 1 -- 172.21.15.63:0/273322149 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f9c0035f0 con 0x7f7fa40b52a0 2024-09-21T07:00:59.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fa1ffb640 1 -- 172.21.15.63:0/273322149 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c003a40 con 0x7f7fa40b52a0 2024-09-21T07:00:59.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.925+0000 7f7fab63f640 1 -- 172.21.15.63:0/273322149 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa40b0a00 con 0x7f7fa40b52a0 2024-09-21T07:00:59.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.926+0000 7f7fab63f640 1 -- 172.21.15.63:0/273322149 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa40ca710 con 0x7f7fa40b52a0 2024-09-21T07:00:59.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.927+0000 7f7fab63f640 1 -- 172.21.15.63:0/273322149 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa40b75e0 con 0x7f7fa40b52a0 2024-09-21T07:00:59.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.927+0000 7f7fa1ffb640 1 -- 172.21.15.63:0/273322149 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7f9c01a070 con 0x7f7fa40b52a0 2024-09-21T07:00:59.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.928+0000 7f7fa1ffb640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7f90078bc0 0x7f7f9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:00:59.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.928+0000 7f7fa1ffb640 1 -- 172.21.15.63:0/273322149 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f7f9c099bb0 con 0x7f7fa40b52a0 2024-09-21T07:00:59.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.928+0000 7f7fa8bda640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7f90078bc0 0x7f7f9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:00:59.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.929+0000 7f7fa8bda640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7f90078bc0 0x7f7f9007b0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40b2950 tx=0x7f7f980095d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:00:59.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:00:59.932+0000 7f7fa1ffb640 1 -- 172.21.15.63:0/273322149 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7f9c061cf0 con 0x7f7fa40b52a0 2024-09-21T07:01:00.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.192+0000 7f7fab63f640 1 -- 172.21.15.63:0/273322149 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f7fa40714c0 con 0x7f7fa40b52a0 2024-09-21T07:01:00.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.194+0000 7f7fa1ffb640 1 -- 172.21.15.63:0/273322149 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f7f9c066720 con 0x7f7fa40b52a0 2024-09-21T07:01:00.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.197+0000 7f7fab63f640 1 -- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7f90078bc0 msgr2=0x7f7f9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.197+0000 7f7fab63f640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7f90078bc0 0x7f7f9007b0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40b2950 tx=0x7f7f980095d0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.197+0000 7f7fab63f640 1 -- 172.21.15.63:0/273322149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fa40b52a0 msgr2=0x7f7fa406e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.197+0000 7f7fab63f640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fa40b52a0 0x7f7fa406e8d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c390 tx=0x7f7f9c00c850 comp rx=0 tx=0).stop 2024-09-21T07:01:00.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.197+0000 7f7fab63f640 1 -- 172.21.15.63:0/273322149 shutdown_connections 2024-09-21T07:01:00.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.197+0000 7f7fab63f640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7f90078bc0 0x7f7f9007b0d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.197+0000 7f7fab63f640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f7fa40d0350 0x7f7fa40af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.197+0000 7f7fab63f640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7fa40cd0b0 0x7f7fa415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.197+0000 7f7fab63f640 1 --2- 172.21.15.63:0/273322149 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7fa40b52a0 0x7f7fa406e8d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.197+0000 7f7fab63f640 1 -- 172.21.15.63:0/273322149 >> 172.21.15.63:0/273322149 conn(0x7f7fa40ceed0 msgr2=0x7f7fa40b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:00.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.197+0000 7f7fab63f640 1 -- 172.21.15.63:0/273322149 shutdown_connections 2024-09-21T07:01:00.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.197+0000 7f7fab63f640 1 -- 172.21.15.63:0/273322149 wait complete. 2024-09-21T07:01:00.210 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-21T07:01:00.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.326+0000 7fdb218d3640 1 -- 172.21.15.63:0/758065143 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb1c0b4350 msgr2=0x7fdb1c0b0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.326+0000 7fdb218d3640 1 --2- 172.21.15.63:0/758065143 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb1c0b4350 0x7fdb1c0b0e00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdb10005fd0 tx=0x7fdb1002a610 comp rx=0 tx=0).stop 2024-09-21T07:01:00.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.326+0000 7fdb218d3640 1 -- 172.21.15.63:0/758065143 shutdown_connections 2024-09-21T07:01:00.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.326+0000 7fdb218d3640 1 --2- 172.21.15.63:0/758065143 >> v2:172.21.15.71:3300/0 conn(0x7fdb1c0b4760 0x7fdb1c0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.326+0000 7fdb218d3640 1 --2- 172.21.15.63:0/758065143 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb1c0b4350 0x7fdb1c0b0e00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.326+0000 7fdb218d3640 1 -- 172.21.15.63:0/758065143 >> 172.21.15.63:0/758065143 conn(0x7fdb1c0b3050 msgr2=0x7fdb1c0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:00.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.326+0000 7fdb218d3640 1 -- 172.21.15.63:0/758065143 shutdown_connections 2024-09-21T07:01:00.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.326+0000 7fdb218d3640 1 -- 172.21.15.63:0/758065143 wait complete. 2024-09-21T07:01:00.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.328+0000 7fdb218d3640 1 Processor -- start 2024-09-21T07:01:00.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.328+0000 7fdb218d3640 1 -- start start 2024-09-21T07:01:00.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.329+0000 7fdb218d3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb1c0b4350 0x7fdb1c1f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:00.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.329+0000 7fdb218d3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdb1c0b4760 0x7fdb1c149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:00.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.329+0000 7fdb218d3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb1c0cf930 0x7fdb1c14a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:00.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.329+0000 7fdb218d3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c15f780 con 0x7fdb1c0cf930 2024-09-21T07:01:00.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.329+0000 7fdb218d3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c0b2640 con 0x7fdb1c0b4350 2024-09-21T07:01:00.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.329+0000 7fdb218d3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fdb1c15f900 con 0x7fdb1c0b4760 2024-09-21T07:01:00.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb1affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb1c0b4350 0x7fdb1c1f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb1b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb1c0cf930 0x7fdb1c14a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb1affd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb1c0b4350 0x7fdb1c1f30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:48864/0 (socket says 172.21.15.63:48864) 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb1a7fc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdb1c0b4760 0x7fdb1c149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb1affd640 1 -- 172.21.15.63:0/1810999436 learned_addr learned my addr 172.21.15.63:0/1810999436 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb1affd640 1 -- 172.21.15.63:0/1810999436 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdb1c0b4760 msgr2=0x7fdb1c149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb1affd640 1 --2- 172.21.15.63:0/1810999436 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdb1c0b4760 0x7fdb1c149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb1affd640 1 -- 172.21.15.63:0/1810999436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb1c0cf930 msgr2=0x7fdb1c14a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb1affd640 1 --2- 172.21.15.63:0/1810999436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb1c0cf930 0x7fdb1c14a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb1affd640 1 -- 172.21.15.63:0/1810999436 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1c147ea0 con 0x7fdb1c0b4350 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb1b7fe640 1 --2- 172.21.15.63:0/1810999436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb1c0cf930 0x7fdb1c14a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb1affd640 1 --2- 172.21.15.63:0/1810999436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb1c0b4350 0x7fdb1c1f30c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00b420 tx=0x7fdb0c00b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb03fff640 1 -- 172.21.15.63:0/1810999436 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c011830 con 0x7fdb1c0b4350 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb218d3640 1 -- 172.21.15.63:0/1810999436 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1c148180 con 0x7fdb1c0b4350 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.330+0000 7fdb03fff640 1 -- 172.21.15.63:0/1810999436 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb0c016070 con 0x7fdb1c0b4350 2024-09-21T07:01:00.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.331+0000 7fdb03fff640 1 -- 172.21.15.63:0/1810999436 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c011d60 con 0x7fdb1c0b4350 2024-09-21T07:01:00.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.331+0000 7fdb218d3640 1 -- 172.21.15.63:0/1810999436 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb1c148740 con 0x7fdb1c0b4350 2024-09-21T07:01:00.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.331+0000 7fdb218d3640 1 -- 172.21.15.63:0/1810999436 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb1c0afce0 con 0x7fdb1c0b4350 2024-09-21T07:01:00.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.332+0000 7fdb03fff640 1 -- 172.21.15.63:0/1810999436 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdb0c01b460 con 0x7fdb1c0b4350 2024-09-21T07:01:00.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.333+0000 7fdb03fff640 1 --2- 172.21.15.63:0/1810999436 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdb08078bc0 0x7fdb0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:00.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.333+0000 7fdb03fff640 1 -- 172.21.15.63:0/1810999436 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fdb0c09a440 con 0x7fdb1c0b4350 2024-09-21T07:01:00.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.333+0000 7fdb1a7fc640 1 --2- 172.21.15.63:0/1810999436 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdb08078bc0 0x7fdb0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:00.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.334+0000 7fdb1a7fc640 1 --2- 172.21.15.63:0/1810999436 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdb08078bc0 0x7fdb0807b0d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdb10033000 tx=0x7fdb10004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:00.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.338+0000 7fdb03fff640 1 -- 172.21.15.63:0/1810999436 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdb0c020020 con 0x7fdb1c0b4350 2024-09-21T07:01:00.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.598+0000 7fdb218d3640 1 -- 172.21.15.63:0/1810999436 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fdb1c1f3600 con 0x7fdb1c0b4350 2024-09-21T07:01:00.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.605+0000 7fdb03fff640 1 -- 172.21.15.63:0/1810999436 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7fdb0c062500 con 0x7fdb1c0b4350 2024-09-21T07:01:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.608+0000 7fdb218d3640 1 -- 172.21.15.63:0/1810999436 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdb08078bc0 msgr2=0x7fdb0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.608+0000 7fdb218d3640 1 --2- 172.21.15.63:0/1810999436 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdb08078bc0 0x7fdb0807b0d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdb10033000 tx=0x7fdb10004730 comp rx=0 tx=0).stop 2024-09-21T07:01:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.608+0000 7fdb218d3640 1 -- 172.21.15.63:0/1810999436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb1c0b4350 msgr2=0x7fdb1c1f30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.608+0000 7fdb218d3640 1 --2- 172.21.15.63:0/1810999436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb1c0b4350 0x7fdb1c1f30c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00b420 tx=0x7fdb0c00b8e0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.608+0000 7fdb218d3640 1 -- 172.21.15.63:0/1810999436 shutdown_connections 2024-09-21T07:01:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.608+0000 7fdb218d3640 1 --2- 172.21.15.63:0/1810999436 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdb08078bc0 0x7fdb0807b0d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.608+0000 7fdb218d3640 1 --2- 172.21.15.63:0/1810999436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdb1c0cf930 0x7fdb1c14a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.608+0000 7fdb218d3640 1 --2- 172.21.15.63:0/1810999436 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdb1c0b4760 0x7fdb1c149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.608+0000 7fdb218d3640 1 --2- 172.21.15.63:0/1810999436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb1c0b4350 0x7fdb1c1f30c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.608+0000 7fdb218d3640 1 -- 172.21.15.63:0/1810999436 >> 172.21.15.63:0/1810999436 conn(0x7fdb1c0b3050 msgr2=0x7fdb1c0b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:00.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.608+0000 7fdb218d3640 1 -- 172.21.15.63:0/1810999436 shutdown_connections 2024-09-21T07:01:00.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.608+0000 7fdb218d3640 1 -- 172.21.15.63:0/1810999436 wait complete. 2024-09-21T07:01:00.621 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-21T07:01:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.737+0000 7f93c3869640 1 -- 172.21.15.63:0/560833730 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93bc0b7530 msgr2=0x7f93bc0d2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.737+0000 7f93c3869640 1 --2- 172.21.15.63:0/560833730 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93bc0b7530 0x7f93bc0d2530 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009820 tx=0x7f93b802a510 comp rx=0 tx=0).stop 2024-09-21T07:01:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.737+0000 7f93c3869640 1 -- 172.21.15.63:0/560833730 shutdown_connections 2024-09-21T07:01:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.737+0000 7f93c3869640 1 --2- 172.21.15.63:0/560833730 >> v2:172.21.15.71:3300/0 conn(0x7f93bc15ef00 0x7f93bc0d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.737+0000 7f93c3869640 1 --2- 172.21.15.63:0/560833730 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93bc0b7530 0x7f93bc0d2530 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.737+0000 7f93c3869640 1 -- 172.21.15.63:0/560833730 >> 172.21.15.63:0/560833730 conn(0x7f93bc08bfd0 msgr2=0x7f93bc0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.737+0000 7f93c3869640 1 -- 172.21.15.63:0/560833730 shutdown_connections 2024-09-21T07:01:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.737+0000 7f93c3869640 1 -- 172.21.15.63:0/560833730 wait complete. 2024-09-21T07:01:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.739+0000 7f93c3869640 1 Processor -- start 2024-09-21T07:01:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.739+0000 7f93c3869640 1 -- start start 2024-09-21T07:01:00.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.740+0000 7f93c3869640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93bc0b2650 0x7f93bc1f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:00.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.740+0000 7f93c3869640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93bc0b7530 0x7f93bc0ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:00.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.740+0000 7f93c3869640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93bc15ef00 0x7f93bc1f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:00.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.740+0000 7f93c3869640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc0b3500 con 0x7f93bc0b2650 2024-09-21T07:01:00.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.740+0000 7f93c3869640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc0b3380 con 0x7f93bc15ef00 2024-09-21T07:01:00.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.740+0000 7f93c3869640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f93bc0d0320 con 0x7f93bc0b7530 2024-09-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.740+0000 7f93c1605640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93bc0b2650 0x7f93bc1f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.740+0000 7f93c1605640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93bc0b2650 0x7f93bc1f63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38894/0 (socket says 172.21.15.63:38894) 2024-09-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.740+0000 7f93c1605640 1 -- 172.21.15.63:0/3743668803 learned_addr learned my addr 172.21.15.63:0/3743668803 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.740+0000 7f93c1e06640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93bc15ef00 0x7f93bc1f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.741+0000 7f93c0e04640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93bc0b7530 0x7f93bc0ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.741+0000 7f93c1605640 1 -- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93bc0b7530 msgr2=0x7f93bc0ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.741+0000 7f93c1605640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93bc0b7530 0x7f93bc0ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.741+0000 7f93c1605640 1 -- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93bc15ef00 msgr2=0x7f93bc1f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.741+0000 7f93c1605640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93bc15ef00 0x7f93bc1f8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.741+0000 7f93c1605640 1 -- 172.21.15.63:0/3743668803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93bc1f9960 con 0x7f93bc0b2650 2024-09-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.741+0000 7f93c1605640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93bc0b2650 0x7f93bc1f63e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f93b802ab00 tx=0x7f93b8004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.741+0000 7f93b1ffb640 1 -- 172.21.15.63:0/3743668803 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b803f070 con 0x7f93bc0b2650 2024-09-21T07:01:00.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.741+0000 7f93c3869640 1 -- 172.21.15.63:0/3743668803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93bc1f5900 con 0x7f93bc0b2650 2024-09-21T07:01:00.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.741+0000 7f93b1ffb640 1 -- 172.21.15.63:0/3743668803 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93b8004e50 con 0x7f93bc0b2650 2024-09-21T07:01:00.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.741+0000 7f93b1ffb640 1 -- 172.21.15.63:0/3743668803 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b8005c30 con 0x7f93bc0b2650 2024-09-21T07:01:00.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.741+0000 7f93c3869640 1 -- 172.21.15.63:0/3743668803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93bc1f9c40 con 0x7f93bc0b2650 2024-09-21T07:01:00.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.742+0000 7f93c3869640 1 -- 172.21.15.63:0/3743668803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93bc0d0860 con 0x7f93bc0b2650 2024-09-21T07:01:00.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.743+0000 7f93b1ffb640 1 -- 172.21.15.63:0/3743668803 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f93b8042070 con 0x7f93bc0b2650 2024-09-21T07:01:00.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.743+0000 7f93b1ffb640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f93a0078b90 0x7f93a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:00.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.744+0000 7f93b1ffb640 1 -- 172.21.15.63:0/3743668803 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f93b80bb8a0 con 0x7f93bc0b2650 2024-09-21T07:01:00.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.744+0000 7f93c0e04640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f93a0078b90 0x7f93a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:00.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.744+0000 7f93c0e04640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f93a0078b90 0x7f93a007b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0b6d20 tx=0x7f93ac005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:00.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.748+0000 7f93b1ffb640 1 -- 172.21.15.63:0/3743668803 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f93b8084040 con 0x7f93bc0b2650 2024-09-21T07:01:00.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.937+0000 7f93c3869640 1 -- 172.21.15.63:0/3743668803 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f93bc06a130 con 0x7f93bc0b2650 2024-09-21T07:01:00.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.938+0000 7f93b1ffb640 1 -- 172.21.15.63:0/3743668803 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7f93b8083940 con 0x7f93bc0b2650 2024-09-21T07:01:00.940 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:00.940 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2024-09-21T07:01:00.940 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-09-21T07:01:00.940 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2024-09-21T07:01:00.940 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2024-09-21T07:01:00.940 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-09-21T07:01:00.940 INFO:teuthology.orchestra.run.smithi063.stdout:] 2024-09-21T07:01:00.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.940+0000 7f93c3869640 1 -- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f93a0078b90 msgr2=0x7f93a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.940+0000 7f93c3869640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f93a0078b90 0x7f93a007b0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0b6d20 tx=0x7f93ac005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:00.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.940+0000 7f93c3869640 1 -- 172.21.15.63:0/3743668803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93bc0b2650 msgr2=0x7f93bc1f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.940+0000 7f93c3869640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93bc0b2650 0x7f93bc1f63e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f93b802ab00 tx=0x7f93b8004a50 comp rx=0 tx=0).stop 2024-09-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.940+0000 7f93c3869640 1 -- 172.21.15.63:0/3743668803 shutdown_connections 2024-09-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.940+0000 7f93c3869640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f93a0078b90 0x7f93a007b0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.940+0000 7f93c3869640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f93bc15ef00 0x7f93bc1f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.940+0000 7f93c3869640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f93bc0b7530 0x7f93bc0ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.940+0000 7f93c3869640 1 --2- 172.21.15.63:0/3743668803 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93bc0b2650 0x7f93bc1f63e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.940+0000 7f93c3869640 1 -- 172.21.15.63:0/3743668803 >> 172.21.15.63:0/3743668803 conn(0x7f93bc08bfd0 msgr2=0x7f93bc06ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.940+0000 7f93c3869640 1 -- 172.21.15.63:0/3743668803 shutdown_connections 2024-09-21T07:01:00.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:00.940+0000 7f93c3869640 1 -- 172.21.15.63:0/3743668803 wait complete. 2024-09-21T07:01:00.953 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T07:01:00.954 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T07:01:01.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.074+0000 7f2f54939640 1 -- 172.21.15.63:0/3844929133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f500b5590 msgr2=0x7f2f500b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:01.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.074+0000 7f2f54939640 1 --2- 172.21.15.63:0/3844929133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f500b5590 0x7f2f500b59a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2f500b3da0 tx=0x7f2f4802a8b0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.074+0000 7f2f54939640 1 -- 172.21.15.63:0/3844929133 shutdown_connections 2024-09-21T07:01:01.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.074+0000 7f2f54939640 1 --2- 172.21.15.63:0/3844929133 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f500b5590 0x7f2f500b59a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.074+0000 7f2f54939640 1 --2- 172.21.15.63:0/3844929133 >> v2:172.21.15.71:3300/0 conn(0x7f2f500ce9c0 0x7f2f500d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.074+0000 7f2f54939640 1 -- 172.21.15.63:0/3844929133 >> 172.21.15.63:0/3844929133 conn(0x7f2f500cef80 msgr2=0x7f2f500cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:01.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.074+0000 7f2f54939640 1 -- 172.21.15.63:0/3844929133 shutdown_connections 2024-09-21T07:01:01.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.074+0000 7f2f54939640 1 -- 172.21.15.63:0/3844929133 wait complete. 2024-09-21T07:01:01.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.076+0000 7f2f54939640 1 Processor -- start 2024-09-21T07:01:01.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.076+0000 7f2f54939640 1 -- start start 2024-09-21T07:01:01.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.077+0000 7f2f54939640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f500b5590 0x7f2f501f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:01.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.077+0000 7f2f54939640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f500ce9c0 0x7f2f50071320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:01.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.077+0000 7f2f54939640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f500cfb10 0x7f2f50071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:01.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.077+0000 7f2f54939640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2f500b6270 con 0x7f2f500ce9c0 2024-09-21T07:01:01.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.077+0000 7f2f54939640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2f500b60f0 con 0x7f2f500b5590 2024-09-21T07:01:01.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.077+0000 7f2f54939640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2f500b63f0 con 0x7f2f500cfb10 2024-09-21T07:01:01.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.077+0000 7f2f4dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f500ce9c0 0x7f2f50071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.077+0000 7f2f4dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f500ce9c0 0x7f2f50071320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38914/0 (socket says 172.21.15.63:38914) 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.077+0000 7f2f4dd9b640 1 -- 172.21.15.63:0/2197852729 learned_addr learned my addr 172.21.15.63:0/2197852729 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.077+0000 7f2f4e59c640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f500b5590 0x7f2f501f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.077+0000 7f2f4ed9d640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f500cfb10 0x7f2f50071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.078+0000 7f2f4dd9b640 1 -- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f500cfb10 msgr2=0x7f2f50071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.078+0000 7f2f4dd9b640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f500cfb10 0x7f2f50071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.078+0000 7f2f4dd9b640 1 -- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f500b5590 msgr2=0x7f2f501f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.078+0000 7f2f4dd9b640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f500b5590 0x7f2f501f5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.078+0000 7f2f4dd9b640 1 -- 172.21.15.63:0/2197852729 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5009f2a0 con 0x7f2f500ce9c0 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.078+0000 7f2f4e59c640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f500b5590 0x7f2f501f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.078+0000 7f2f4dd9b640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f500ce9c0 0x7f2f50071320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400e7c0 tx=0x7f2f4400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.078+0000 7f2f3effd640 1 -- 172.21.15.63:0/2197852729 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4400cc60 con 0x7f2f500ce9c0 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.078+0000 7f2f54939640 1 -- 172.21.15.63:0/2197852729 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5009d390 con 0x7f2f500ce9c0 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.078+0000 7f2f3effd640 1 -- 172.21.15.63:0/2197852729 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f44010430 con 0x7f2f500ce9c0 2024-09-21T07:01:01.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.078+0000 7f2f3effd640 1 -- 172.21.15.63:0/2197852729 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44010860 con 0x7f2f500ce9c0 2024-09-21T07:01:01.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.078+0000 7f2f54939640 1 -- 172.21.15.63:0/2197852729 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5009d950 con 0x7f2f500ce9c0 2024-09-21T07:01:01.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.079+0000 7f2f54939640 1 -- 172.21.15.63:0/2197852729 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5009efc0 con 0x7f2f500ce9c0 2024-09-21T07:01:01.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.080+0000 7f2f3effd640 1 -- 172.21.15.63:0/2197852729 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f44010a00 con 0x7f2f500ce9c0 2024-09-21T07:01:01.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.081+0000 7f2f3effd640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2f30078b90 0x7f2f3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:01.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.081+0000 7f2f3effd640 1 -- 172.21.15.63:0/2197852729 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f2f4409bcc0 con 0x7f2f500ce9c0 2024-09-21T07:01:01.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.081+0000 7f2f4e59c640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2f30078b90 0x7f2f3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:01.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.081+0000 7f2f4e59c640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2f30078b90 0x7f2f3007b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2f40007910 tx=0x7f2f40009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:01.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.085+0000 7f2f3effd640 1 -- 172.21.15.63:0/2197852729 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2f44064450 con 0x7f2f500ce9c0 2024-09-21T07:01:01.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.272+0000 7f2f54939640 1 -- 172.21.15.63:0/2197852729 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2f500ce2a0 con 0x7f2f500ce9c0 2024-09-21T07:01:01.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.754+0000 7f2f3effd640 1 -- 172.21.15.63:0/2197852729 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7f2f44063d50 con 0x7f2f500ce9c0 2024-09-21T07:01:01.756 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2024-09-21T07:01:01.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.757+0000 7f2f54939640 1 -- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2f30078b90 msgr2=0x7f2f3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:01.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.757+0000 7f2f54939640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2f30078b90 0x7f2f3007b0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2f40007910 tx=0x7f2f40009040 comp rx=0 tx=0).stop 2024-09-21T07:01:01.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.757+0000 7f2f54939640 1 -- 172.21.15.63:0/2197852729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f500ce9c0 msgr2=0x7f2f50071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:01.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.757+0000 7f2f54939640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f500ce9c0 0x7f2f50071320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400e7c0 tx=0x7f2f4400ec80 comp rx=0 tx=0).stop 2024-09-21T07:01:01.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.757+0000 7f2f54939640 1 -- 172.21.15.63:0/2197852729 shutdown_connections 2024-09-21T07:01:01.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.757+0000 7f2f54939640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2f30078b90 0x7f2f3007b0a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.757+0000 7f2f54939640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f500cfb10 0x7f2f50071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.757+0000 7f2f54939640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f500ce9c0 0x7f2f50071320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.757+0000 7f2f54939640 1 --2- 172.21.15.63:0/2197852729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f500b5590 0x7f2f501f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.757+0000 7f2f54939640 1 -- 172.21.15.63:0/2197852729 >> 172.21.15.63:0/2197852729 conn(0x7f2f500cef80 msgr2=0x7f2f5009c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:01.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.757+0000 7f2f54939640 1 -- 172.21.15.63:0/2197852729 shutdown_connections 2024-09-21T07:01:01.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.757+0000 7f2f54939640 1 -- 172.21.15.63:0/2197852729 wait complete. 2024-09-21T07:01:01.774 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T07:01:01.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.901+0000 7f259108b640 1 -- 172.21.15.63:0/3335473259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2578003ae0 msgr2=0x7f2578003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:01.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.901+0000 7f259108b640 1 --2- 172.21.15.63:0/3335473259 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2578003ae0 0x7f2578003f50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2584009b50 tx=0x7f2578005830 comp rx=0 tx=0).stop 2024-09-21T07:01:01.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.901+0000 7f258b59e640 1 -- 172.21.15.63:0/3335473259 reap_dead start 2024-09-21T07:01:01.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.901+0000 7f259108b640 1 -- 172.21.15.63:0/3335473259 shutdown_connections 2024-09-21T07:01:01.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.901+0000 7f259108b640 1 -- 172.21.15.63:0/3335473259 >> 172.21.15.63:0/3335473259 conn(0x7f258c06cf90 msgr2=0x7f258c06d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:01.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.901+0000 7f259108b640 1 -- 172.21.15.63:0/3335473259 shutdown_connections 2024-09-21T07:01:01.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.901+0000 7f259108b640 1 -- 172.21.15.63:0/3335473259 wait complete. 2024-09-21T07:01:01.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.903+0000 7f259108b640 1 Processor -- start 2024-09-21T07:01:01.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.903+0000 7f259108b640 1 -- start start 2024-09-21T07:01:01.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.904+0000 7f259108b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2578003ae0 0x7f258c1f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:01.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.904+0000 7f259108b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c1f5110 0x7f258c153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:01.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.904+0000 7f259108b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c153ca0 0x7f258c0ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:01.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.904+0000 7f259108b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f258c159260 con 0x7f258c153ca0 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.904+0000 7f259108b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f258c1590e0 con 0x7f258c1f5110 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.904+0000 7f259108b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f258c1593e0 con 0x7f2578003ae0 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.904+0000 7f258b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c153ca0 0x7f258c0ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.904+0000 7f258b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c153ca0 0x7f258c0ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38922/0 (socket says 172.21.15.63:38922) 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.904+0000 7f258b59e640 1 -- 172.21.15.63:0/537676775 learned_addr learned my addr 172.21.15.63:0/537676775 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f258ad9d640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2578003ae0 0x7f258c1f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f258a59c640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c1f5110 0x7f258c153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f258b59e640 1 -- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2578003ae0 msgr2=0x7f258c1f5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f258b59e640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2578003ae0 0x7f258c1f5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f258b59e640 1 -- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c1f5110 msgr2=0x7f258c153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f258b59e640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c1f5110 0x7f258c153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f258b59e640 1 -- 172.21.15.63:0/537676775 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c1540b0 con 0x7f258c153ca0 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f258a59c640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c1f5110 0x7f258c153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:01.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f258b59e640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c153ca0 0x7f258c0ad8b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f258c0733c0 tx=0x7f257c006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:01.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f25837fe640 1 -- 172.21.15.63:0/537676775 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c00fa00 con 0x7f258c153ca0 2024-09-21T07:01:01.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f25837fe640 1 -- 172.21.15.63:0/537676775 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f257c018070 con 0x7f258c153ca0 2024-09-21T07:01:01.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f259108b640 1 -- 172.21.15.63:0/537676775 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258c155780 con 0x7f258c153ca0 2024-09-21T07:01:01.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f25837fe640 1 -- 172.21.15.63:0/537676775 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c00fe40 con 0x7f258c153ca0 2024-09-21T07:01:01.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.905+0000 7f259108b640 1 -- 172.21.15.63:0/537676775 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258c155ed0 con 0x7f258c153ca0 2024-09-21T07:01:01.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.906+0000 7f259108b640 1 -- 172.21.15.63:0/537676775 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258c06fd80 con 0x7f258c153ca0 2024-09-21T07:01:01.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.907+0000 7f25837fe640 1 -- 172.21.15.63:0/537676775 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f257c01d460 con 0x7f258c153ca0 2024-09-21T07:01:01.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.908+0000 7f25837fe640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f256c078bc0 0x7f256c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:01.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.908+0000 7f25837fe640 1 -- 172.21.15.63:0/537676775 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7f257c09b2e0 con 0x7f258c153ca0 2024-09-21T07:01:01.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.908+0000 7f258ad9d640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f256c078bc0 0x7f256c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:01.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.908+0000 7f258ad9d640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f256c078bc0 0x7f256c07b0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2584035000 tx=0x7f258402d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:01.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:01.913+0000 7f25837fe640 1 -- 172.21.15.63:0/537676775 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f258c1540b0 con 0x7f258c153ca0 2024-09-21T07:01:02.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.099+0000 7f259108b640 1 -- 172.21.15.63:0/537676775 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f258c155950 con 0x7f258c153ca0 2024-09-21T07:01:02.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.760+0000 7f25837fe640 1 -- 172.21.15.63:0/537676775 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7f257c063900 con 0x7f258c153ca0 2024-09-21T07:01:02.762 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2024-09-21T07:01:02.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.764+0000 7f259108b640 1 -- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f256c078bc0 msgr2=0x7f256c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:02.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.764+0000 7f259108b640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f256c078bc0 0x7f256c07b0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2584035000 tx=0x7f258402d040 comp rx=0 tx=0).stop 2024-09-21T07:01:02.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.764+0000 7f259108b640 1 -- 172.21.15.63:0/537676775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c153ca0 msgr2=0x7f258c0ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:02.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.764+0000 7f259108b640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c153ca0 0x7f258c0ad8b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f258c0733c0 tx=0x7f257c006720 comp rx=0 tx=0).stop 2024-09-21T07:01:02.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.764+0000 7f259108b640 1 -- 172.21.15.63:0/537676775 shutdown_connections 2024-09-21T07:01:02.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.764+0000 7f259108b640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f256c078bc0 0x7f256c07b0d0 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2584035000 tx=0x7f258402d040 comp rx=0 tx=0).stop 2024-09-21T07:01:02.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.764+0000 7f259108b640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f258c153ca0 0x7f258c0ad8b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:02.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.764+0000 7f259108b640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f258c1f5110 0x7f258c153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:02.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.764+0000 7f259108b640 1 --2- 172.21.15.63:0/537676775 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2578003ae0 0x7f258c1f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:02.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.764+0000 7f259108b640 1 -- 172.21.15.63:0/537676775 >> 172.21.15.63:0/537676775 conn(0x7f258c06cf90 msgr2=0x7f258c075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:02.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.766+0000 7f259108b640 1 -- 172.21.15.63:0/537676775 shutdown_connections 2024-09-21T07:01:02.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.766+0000 7f259108b640 1 -- 172.21.15.63:0/537676775 wait complete. 2024-09-21T07:01:02.789 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T07:01:02.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.913+0000 7f3af6762640 1 -- 172.21.15.63:0/1000053595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af00b7530 msgr2=0x7f3af00d2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:02.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.913+0000 7f3af6762640 1 --2- 172.21.15.63:0/1000053595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af00b7530 0x7f3af00d2530 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3af00ba3a0 tx=0x7f3ae002a5f0 comp rx=0 tx=0).stop 2024-09-21T07:01:02.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.913+0000 7f3af6762640 1 -- 172.21.15.63:0/1000053595 shutdown_connections 2024-09-21T07:01:02.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.913+0000 7f3af6762640 1 --2- 172.21.15.63:0/1000053595 >> v2:172.21.15.71:3300/0 conn(0x7f3af00cf310 0x7f3af00cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:02.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.913+0000 7f3af6762640 1 --2- 172.21.15.63:0/1000053595 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af00b7530 0x7f3af00d2530 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:02.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.913+0000 7f3af6762640 1 -- 172.21.15.63:0/1000053595 >> 172.21.15.63:0/1000053595 conn(0x7f3af008bfd0 msgr2=0x7f3af00d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:02.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.913+0000 7f3af6762640 1 -- 172.21.15.63:0/1000053595 shutdown_connections 2024-09-21T07:01:02.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.913+0000 7f3af6762640 1 -- 172.21.15.63:0/1000053595 wait complete. 2024-09-21T07:01:02.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.915+0000 7f3af6762640 1 Processor -- start 2024-09-21T07:01:02.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.915+0000 7f3af6762640 1 -- start start 2024-09-21T07:01:02.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.916+0000 7f3af6762640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af00b7530 0x7f3af0161990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:02.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.916+0000 7f3af6762640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3af00cf310 0x7f3af0152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:02.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.916+0000 7f3af6762640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3af015ef00 0x7f3af00cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:02.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.916+0000 7f3af6762640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3af00cfff0 con 0x7f3af00b7530 2024-09-21T07:01:02.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.916+0000 7f3af6762640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3af00cfe70 con 0x7f3af00cf310 2024-09-21T07:01:02.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.916+0000 7f3af6762640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3af00d0170 con 0x7f3af015ef00 2024-09-21T07:01:02.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.916+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af00b7530 0x7f3af0161990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:02.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.916+0000 7f3aeffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af00b7530 0x7f3af0161990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38942/0 (socket says 172.21.15.63:38942) 2024-09-21T07:01:02.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.916+0000 7f3aeffff640 1 -- 172.21.15.63:0/14439365 learned_addr learned my addr 172.21.15.63:0/14439365 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:02.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.916+0000 7f3aef7fe640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3af00cf310 0x7f3af0152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:02.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.917+0000 7f3af4cff640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3af015ef00 0x7f3af00cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:02.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.917+0000 7f3aeffff640 1 -- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3af015ef00 msgr2=0x7f3af00cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:02.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.917+0000 7f3aeffff640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3af015ef00 0x7f3af00cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:02.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.917+0000 7f3aeffff640 1 -- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3af00cf310 msgr2=0x7f3af0152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:02.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.917+0000 7f3aeffff640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3af00cf310 0x7f3af0152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:02.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.917+0000 7f3aeffff640 1 -- 172.21.15.63:0/14439365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af015e0e0 con 0x7f3af00b7530 2024-09-21T07:01:02.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.917+0000 7f3aeffff640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af00b7530 0x7f3af0161990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00099d0 tx=0x7f3ae00052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:02.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.917+0000 7f3aecff9640 1 -- 172.21.15.63:0/14439365 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0005cf0 con 0x7f3af00b7530 2024-09-21T07:01:02.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.917+0000 7f3aecff9640 1 -- 172.21.15.63:0/14439365 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ae0031c40 con 0x7f3af00b7530 2024-09-21T07:01:02.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.917+0000 7f3af6762640 1 -- 172.21.15.63:0/14439365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af00ce440 con 0x7f3af00b7530 2024-09-21T07:01:02.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.917+0000 7f3aecff9640 1 -- 172.21.15.63:0/14439365 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0004a00 con 0x7f3af00b7530 2024-09-21T07:01:02.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.917+0000 7f3af6762640 1 -- 172.21.15.63:0/14439365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af0160eb0 con 0x7f3af00b7530 2024-09-21T07:01:02.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.918+0000 7f3af6762640 1 -- 172.21.15.63:0/14439365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af00d0670 con 0x7f3af00b7530 2024-09-21T07:01:02.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.919+0000 7f3aecff9640 1 -- 172.21.15.63:0/14439365 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ae0004ba0 con 0x7f3af00b7530 2024-09-21T07:01:02.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.920+0000 7f3aecff9640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3adc078b90 0x7f3adc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:02.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.920+0000 7f3aecff9640 1 -- 172.21.15.63:0/14439365 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7f3ae00bbfd0 con 0x7f3af00b7530 2024-09-21T07:01:02.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.920+0000 7f3aef7fe640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3adc078b90 0x7f3adc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:02.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.921+0000 7f3aef7fe640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3adc078b90 0x7f3adc07b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3af015b410 tx=0x7f3ae4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:02.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:02.925+0000 7f3aecff9640 1 -- 172.21.15.63:0/14439365 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3ae003f030 con 0x7f3af00b7530 2024-09-21T07:01:03.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.149+0000 7f3af6762640 1 -- 172.21.15.63:0/14439365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3af006a130 con 0x7f3af00b7530 2024-09-21T07:01:03.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.762+0000 7f3aecff9640 1 -- 172.21.15.63:0/14439365 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f3ae0031770 con 0x7f3af00b7530 2024-09-21T07:01:03.764 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 4 and data pool 5 2024-09-21T07:01:03.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.767+0000 7f3af6762640 1 -- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3adc078b90 msgr2=0x7f3adc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.767+0000 7f3af6762640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3adc078b90 0x7f3adc07b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3af015b410 tx=0x7f3ae4009040 comp rx=0 tx=0).stop 2024-09-21T07:01:03.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.767+0000 7f3af6762640 1 -- 172.21.15.63:0/14439365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af00b7530 msgr2=0x7f3af0161990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.767+0000 7f3af6762640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af00b7530 0x7f3af0161990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00099d0 tx=0x7f3ae00052f0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.767+0000 7f3af6762640 1 -- 172.21.15.63:0/14439365 shutdown_connections 2024-09-21T07:01:03.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.767+0000 7f3af6762640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3adc078b90 0x7f3adc07b0a0 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3af015b410 tx=0x7f3ae4009040 comp rx=0 tx=0).stop 2024-09-21T07:01:03.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.767+0000 7f3af6762640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3af015ef00 0x7f3af00cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.767+0000 7f3af6762640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3af00cf310 0x7f3af0152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.767+0000 7f3af6762640 1 --2- 172.21.15.63:0/14439365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3af00b7530 0x7f3af0161990 secure :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00099d0 tx=0x7f3ae00052f0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.767+0000 7f3af6762640 1 -- 172.21.15.63:0/14439365 >> 172.21.15.63:0/14439365 conn(0x7f3af008bfd0 msgr2=0x7f3af00d18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:03.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.769+0000 7f3af6762640 1 -- 172.21.15.63:0/14439365 shutdown_connections 2024-09-21T07:01:03.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.769+0000 7f3af6762640 1 -- 172.21.15.63:0/14439365 wait complete. 2024-09-21T07:01:03.804 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.923+0000 7f858d063640 1 -- 172.21.15.63:0/1376989931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85700053d0 msgr2=0x7f857000ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.923+0000 7f858d063640 1 --2- 172.21.15.63:0/1376989931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85700053d0 0x7f857000ba80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f858000c610 tx=0x7f8570005830 comp rx=0 tx=0).stop 2024-09-21T07:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.923+0000 7f858d063640 1 -- 172.21.15.63:0/1376989931 shutdown_connections 2024-09-21T07:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.923+0000 7f858d063640 1 --2- 172.21.15.63:0/1376989931 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85700053d0 0x7f857000ba80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.923+0000 7f858d063640 1 -- 172.21.15.63:0/1376989931 >> 172.21.15.63:0/1376989931 conn(0x7f85880d45e0 msgr2=0x7f85880d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.923+0000 7f858d063640 1 -- 172.21.15.63:0/1376989931 shutdown_connections 2024-09-21T07:01:03.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.923+0000 7f858d063640 1 -- 172.21.15.63:0/1376989931 wait complete. 2024-09-21T07:01:03.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.925+0000 7f858d063640 1 Processor -- start 2024-09-21T07:01:03.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.925+0000 7f858d063640 1 -- start start 2024-09-21T07:01:03.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.926+0000 7f858d063640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85700053d0 0x7f8588154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:03.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.926+0000 7f858d063640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f858815d280 0x7f85880b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:03.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.926+0000 7f858d063640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f858815cd30 0x7f85880b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:03.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.926+0000 7f858d063640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f85880d0bf0 con 0x7f858815cd30 2024-09-21T07:01:03.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.926+0000 7f858d063640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f85880d36b0 con 0x7f858815d280 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.926+0000 7f858d063640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f85880d0d70 con 0x7f85700053d0 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f858759e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f858815cd30 0x7f85880b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f858759e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f858815cd30 0x7f85880b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38962/0 (socket says 172.21.15.63:38962) 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f8586d9d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85700053d0 0x7f8588154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f858759e640 1 -- 172.21.15.63:0/4115691832 learned_addr learned my addr 172.21.15.63:0/4115691832 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f858659c640 1 --2- 172.21.15.63:0/4115691832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f858815d280 0x7f85880b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f858759e640 1 -- 172.21.15.63:0/4115691832 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85700053d0 msgr2=0x7f8588154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f858759e640 1 --2- 172.21.15.63:0/4115691832 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85700053d0 0x7f8588154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f858759e640 1 -- 172.21.15.63:0/4115691832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f858815d280 msgr2=0x7f85880b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f858759e640 1 --2- 172.21.15.63:0/4115691832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f858815d280 0x7f85880b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f858759e640 1 -- 172.21.15.63:0/4115691832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8588155030 con 0x7f858815cd30 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f858759e640 1 --2- 172.21.15.63:0/4115691832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f858815cd30 0x7f85880b4420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8580007010 tx=0x7f858000c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f856f7fe640 1 -- 172.21.15.63:0/4115691832 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580039070 con 0x7f858815cd30 2024-09-21T07:01:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f856f7fe640 1 -- 172.21.15.63:0/4115691832 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f858002bd60 con 0x7f858815cd30 2024-09-21T07:01:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f858d063640 1 -- 172.21.15.63:0/4115691832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8588161150 con 0x7f858815cd30 2024-09-21T07:01:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f856f7fe640 1 -- 172.21.15.63:0/4115691832 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580006290 con 0x7f858815cd30 2024-09-21T07:01:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.927+0000 7f858d063640 1 -- 172.21.15.63:0/4115691832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8588161710 con 0x7f858815cd30 2024-09-21T07:01:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.928+0000 7f858d063640 1 -- 172.21.15.63:0/4115691832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85880d1270 con 0x7f858815cd30 2024-09-21T07:01:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.930+0000 7f856f7fe640 1 -- 172.21.15.63:0/4115691832 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8580006430 con 0x7f858815cd30 2024-09-21T07:01:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.930+0000 7f856f7fe640 1 --2- 172.21.15.63:0/4115691832 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8574078b90 0x7f857407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.931+0000 7f856f7fe640 1 -- 172.21.15.63:0/4115691832 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f85800bb180 con 0x7f858815cd30 2024-09-21T07:01:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.931+0000 7f8586d9d640 1 --2- 172.21.15.63:0/4115691832 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8574078b90 0x7f857407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:03.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.931+0000 7f8586d9d640 1 --2- 172.21.15.63:0/4115691832 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8574078b90 0x7f857407b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8578006fd0 tx=0x7f8578006bc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:03.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:03.934+0000 7f856f7fe640 1 -- 172.21.15.63:0/4115691832 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f8580083880 con 0x7f858815cd30 2024-09-21T07:01:04.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.121+0000 7f858d063640 1 -- 172.21.15.63:0/4115691832 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85880b23b0 con 0x7f858815cd30 2024-09-21T07:01:04.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.122+0000 7f856f7fe640 1 -- 172.21.15.63:0/4115691832 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16634 (secure 0 0 0) 0x7f8580083180 con 0x7f858815cd30 2024-09-21T07:01:04.124 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:04.124 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":32,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:01:03.150849+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:01:01.276831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T07:01:02.103831+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:01:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.124+0000 7f858d063640 1 -- 172.21.15.63:0/4115691832 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8574078b90 msgr2=0x7f857407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.124+0000 7f858d063640 1 --2- 172.21.15.63:0/4115691832 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8574078b90 0x7f857407b0a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8578006fd0 tx=0x7f8578006bc0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.124+0000 7f858d063640 1 -- 172.21.15.63:0/4115691832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f858815cd30 msgr2=0x7f85880b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:04.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.124+0000 7f858d063640 1 --2- 172.21.15.63:0/4115691832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f858815cd30 0x7f85880b4420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8580007010 tx=0x7f858000c260 comp rx=0 tx=0).stop 2024-09-21T07:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.124+0000 7f858d063640 1 -- 172.21.15.63:0/4115691832 shutdown_connections 2024-09-21T07:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.124+0000 7f858d063640 1 --2- 172.21.15.63:0/4115691832 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f8574078b90 0x7f857407b0a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.124+0000 7f858d063640 1 --2- 172.21.15.63:0/4115691832 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f858815cd30 0x7f85880b4420 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.124+0000 7f858d063640 1 --2- 172.21.15.63:0/4115691832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f858815d280 0x7f85880b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.124+0000 7f858d063640 1 --2- 172.21.15.63:0/4115691832 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f85700053d0 0x7f8588154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.124+0000 7f858d063640 1 -- 172.21.15.63:0/4115691832 >> 172.21.15.63:0/4115691832 conn(0x7f85880d45e0 msgr2=0x7f85880d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.124+0000 7f858d063640 1 -- 172.21.15.63:0/4115691832 shutdown_connections 2024-09-21T07:01:04.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.125+0000 7f858d063640 1 -- 172.21.15.63:0/4115691832 wait complete. 2024-09-21T07:01:04.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:01:04.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.252+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1892600581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d40b7530 msgr2=0x7fc0d40d2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:04.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.252+0000 7fc0dbf71640 1 --2- 172.21.15.63:0/1892600581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d40b7530 0x7fc0d40d2530 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc0d408cdf0 tx=0x7fc0c402a980 comp rx=0 tx=0).stop 2024-09-21T07:01:04.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.252+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1892600581 shutdown_connections 2024-09-21T07:01:04.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.252+0000 7fc0dbf71640 1 --2- 172.21.15.63:0/1892600581 >> v2:172.21.15.71:3300/0 conn(0x7fc0d415ef00 0x7fc0d40d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.252+0000 7fc0dbf71640 1 --2- 172.21.15.63:0/1892600581 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d40b7530 0x7fc0d40d2530 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.252+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1892600581 >> 172.21.15.63:0/1892600581 conn(0x7fc0d408bfd0 msgr2=0x7fc0d40d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:04.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.252+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1892600581 shutdown_connections 2024-09-21T07:01:04.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.252+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1892600581 wait complete. 2024-09-21T07:01:04.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.254+0000 7fc0dbf71640 1 Processor -- start 2024-09-21T07:01:04.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.254+0000 7fc0dbf71640 1 -- start start 2024-09-21T07:01:04.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.255+0000 7fc0dbf71640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d40b2650 0x7fc0d40ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:04.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.255+0000 7fc0dbf71640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc0d40b7530 0x7fc0d40c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:04.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.255+0000 7fc0dbf71640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d415ef00 0x7fc0d41f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:04.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.255+0000 7fc0dbf71640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d40b3500 con 0x7fc0d415ef00 2024-09-21T07:01:04.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.255+0000 7fc0dbf71640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d40b3380 con 0x7fc0d40b2650 2024-09-21T07:01:04.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.255+0000 7fc0dbf71640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d40d5530 con 0x7fc0d40b7530 2024-09-21T07:01:04.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.255+0000 7fc0da50e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d415ef00 0x7fc0d41f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:04.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.255+0000 7fc0d9d0d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d40b2650 0x7fc0d40ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:04.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.255+0000 7fc0da50e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d415ef00 0x7fc0d41f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38984/0 (socket says 172.21.15.63:38984) 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.255+0000 7fc0d950c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc0d40b7530 0x7fc0d40c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.255+0000 7fc0da50e640 1 -- 172.21.15.63:0/1299861291 learned_addr learned my addr 172.21.15.63:0/1299861291 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.256+0000 7fc0da50e640 1 -- 172.21.15.63:0/1299861291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc0d40b7530 msgr2=0x7fc0d40c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.256+0000 7fc0da50e640 1 --2- 172.21.15.63:0/1299861291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc0d40b7530 0x7fc0d40c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.256+0000 7fc0da50e640 1 -- 172.21.15.63:0/1299861291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d40b2650 msgr2=0x7fc0d40ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.256+0000 7fc0da50e640 1 --2- 172.21.15.63:0/1299861291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d40b2650 0x7fc0d40ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.256+0000 7fc0da50e640 1 -- 172.21.15.63:0/1299861291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d40ce680 con 0x7fc0d415ef00 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.256+0000 7fc0d9d0d640 1 --2- 172.21.15.63:0/1299861291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d40b2650 0x7fc0d40ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.256+0000 7fc0da50e640 1 --2- 172.21.15.63:0/1299861291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d415ef00 0x7fc0d41f9150 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc00b3e0 tx=0x7fc0cc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.256+0000 7fc0d27fc640 1 -- 172.21.15.63:0/1299861291 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc015030 con 0x7fc0d415ef00 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.256+0000 7fc0d27fc640 1 -- 172.21.15.63:0/1299861291 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0cc004110 con 0x7fc0d415ef00 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.256+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1299861291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d40c9eb0 con 0x7fc0d415ef00 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.256+0000 7fc0d27fc640 1 -- 172.21.15.63:0/1299861291 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc011630 con 0x7fc0d415ef00 2024-09-21T07:01:04.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.256+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1299861291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d40ca470 con 0x7fc0d415ef00 2024-09-21T07:01:04.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.257+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1299861291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d40c9c20 con 0x7fc0d415ef00 2024-09-21T07:01:04.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.258+0000 7fc0d27fc640 1 -- 172.21.15.63:0/1299861291 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc0cc018070 con 0x7fc0d415ef00 2024-09-21T07:01:04.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.258+0000 7fc0d27fc640 1 --2- 172.21.15.63:0/1299861291 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc0c0078b90 0x7fc0c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:04.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.259+0000 7fc0d27fc640 1 -- 172.21.15.63:0/1299861291 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc0cc09a610 con 0x7fc0d415ef00 2024-09-21T07:01:04.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.259+0000 7fc0d9d0d640 1 --2- 172.21.15.63:0/1299861291 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc0c0078b90 0x7fc0c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:04.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.259+0000 7fc0d9d0d640 1 --2- 172.21.15.63:0/1299861291 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc0c0078b90 0x7fc0c007b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4035000 tx=0x7fc0c4004ab0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:04.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.263+0000 7fc0d27fc640 1 -- 172.21.15.63:0/1299861291 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc0cc062490 con 0x7fc0d415ef00 2024-09-21T07:01:04.451 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.449+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1299861291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0d40d0660 con 0x7fc0d415ef00 2024-09-21T07:01:04.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.451+0000 7fc0d27fc640 1 -- 172.21.15.63:0/1299861291 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16634 (secure 0 0 0) 0x7fc0cc06b030 con 0x7fc0d415ef00 2024-09-21T07:01:04.453 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:04.453 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":32,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:01:03.150849+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:01:01.276831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T07:01:02.103831+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:01:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.453+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1299861291 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc0c0078b90 msgr2=0x7fc0c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.453+0000 7fc0dbf71640 1 --2- 172.21.15.63:0/1299861291 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc0c0078b90 0x7fc0c007b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4035000 tx=0x7fc0c4004ab0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.453+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1299861291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d415ef00 msgr2=0x7fc0d41f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.453+0000 7fc0dbf71640 1 --2- 172.21.15.63:0/1299861291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d415ef00 0x7fc0d41f9150 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc00b3e0 tx=0x7fc0cc00b8a0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.453+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1299861291 shutdown_connections 2024-09-21T07:01:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.453+0000 7fc0dbf71640 1 --2- 172.21.15.63:0/1299861291 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc0c0078b90 0x7fc0c007b0a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.453+0000 7fc0dbf71640 1 --2- 172.21.15.63:0/1299861291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0d415ef00 0x7fc0d41f9150 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.453+0000 7fc0dbf71640 1 --2- 172.21.15.63:0/1299861291 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc0d40b7530 0x7fc0d40c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.453+0000 7fc0dbf71640 1 --2- 172.21.15.63:0/1299861291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0d40b2650 0x7fc0d40ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.453+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1299861291 >> 172.21.15.63:0/1299861291 conn(0x7fc0d408bfd0 msgr2=0x7fc0d40b9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:04.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.453+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1299861291 shutdown_connections 2024-09-21T07:01:04.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.453+0000 7fc0dbf71640 1 -- 172.21.15.63:0/1299861291 wait complete. 2024-09-21T07:01:04.466 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-21T07:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.586+0000 7f56782dc640 1 -- 172.21.15.63:0/420205465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f565c003ae0 msgr2=0x7f565c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.586+0000 7f56782dc640 1 --2- 172.21.15.63:0/420205465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f565c003ae0 0x7f565c003f50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f566c009d00 tx=0x7f565c005830 comp rx=0 tx=0).stop 2024-09-21T07:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.586+0000 7f5676879640 1 -- 172.21.15.63:0/420205465 reap_dead start 2024-09-21T07:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.587+0000 7f56782dc640 1 -- 172.21.15.63:0/420205465 shutdown_connections 2024-09-21T07:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.587+0000 7f56782dc640 1 -- 172.21.15.63:0/420205465 >> 172.21.15.63:0/420205465 conn(0x7f56700b2f70 msgr2=0x7f56700b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.587+0000 7f56782dc640 1 -- 172.21.15.63:0/420205465 shutdown_connections 2024-09-21T07:01:04.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.587+0000 7f56782dc640 1 -- 172.21.15.63:0/420205465 wait complete. 2024-09-21T07:01:04.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.590+0000 7f56782dc640 1 Processor -- start 2024-09-21T07:01:04.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.590+0000 7f56782dc640 1 -- start start 2024-09-21T07:01:04.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.592+0000 7f56782dc640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f565c003ae0 0x7f567009ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:04.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.592+0000 7f56782dc640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f56701f3ff0 0x7f56700ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:04.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.592+0000 7f56782dc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5670157f30 0x7f567015c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:04.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.592+0000 7f56782dc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f56700cfa50 con 0x7f5670157f30 2024-09-21T07:01:04.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.592+0000 7f56782dc640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56700b69c0 con 0x7f565c003ae0 2024-09-21T07:01:04.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.592+0000 7f56782dc640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f56700cfbd0 con 0x7f56701f3ff0 2024-09-21T07:01:04.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.592+0000 7f5676879640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5670157f30 0x7f567015c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.592+0000 7f5676879640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5670157f30 0x7f567015c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39006/0 (socket says 172.21.15.63:39006) 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.592+0000 7f5676879640 1 -- 172.21.15.63:0/506391310 learned_addr learned my addr 172.21.15.63:0/506391310 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.592+0000 7f5676078640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f565c003ae0 0x7f567009ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.592+0000 7f5675877640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f56701f3ff0 0x7f56700ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.593+0000 7f5676879640 1 -- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f56701f3ff0 msgr2=0x7f56700ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.593+0000 7f5676879640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f56701f3ff0 0x7f56700ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.593+0000 7f5676879640 1 -- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f565c003ae0 msgr2=0x7f567009ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.593+0000 7f5676879640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f565c003ae0 0x7f567009ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.593+0000 7f5676879640 1 -- 172.21.15.63:0/506391310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56701f7510 con 0x7f5670157f30 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.593+0000 7f5676078640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f565c003ae0 0x7f567009ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.593+0000 7f5676879640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5670157f30 0x7f567015c190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5668000f80 tx=0x7f5668006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.593+0000 7f5666ffd640 1 -- 172.21.15.63:0/506391310 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566800fa80 con 0x7f5670157f30 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.593+0000 7f5666ffd640 1 -- 172.21.15.63:0/506391310 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5668018070 con 0x7f5670157f30 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.593+0000 7f56782dc640 1 -- 172.21.15.63:0/506391310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56701f3510 con 0x7f5670157f30 2024-09-21T07:01:04.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.593+0000 7f5666ffd640 1 -- 172.21.15.63:0/506391310 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668011430 con 0x7f5670157f30 2024-09-21T07:01:04.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.593+0000 7f56782dc640 1 -- 172.21.15.63:0/506391310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56701f3ad0 con 0x7f5670157f30 2024-09-21T07:01:04.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.594+0000 7f56782dc640 1 -- 172.21.15.63:0/506391310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56700c7da0 con 0x7f5670157f30 2024-09-21T07:01:04.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.595+0000 7f5666ffd640 1 -- 172.21.15.63:0/506391310 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f56680115d0 con 0x7f5670157f30 2024-09-21T07:01:04.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.596+0000 7f5666ffd640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5654078bc0 0x7f565407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:04.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.596+0000 7f5666ffd640 1 -- 172.21.15.63:0/506391310 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f566809b5b0 con 0x7f5670157f30 2024-09-21T07:01:04.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.596+0000 7f5676078640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5654078bc0 0x7f565407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:04.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.597+0000 7f5676078640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5654078bc0 0x7f565407b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f566c035000 tx=0x7f566c0046c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:04.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.600+0000 7f5666ffd640 1 -- 172.21.15.63:0/506391310 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f56700c7da0 con 0x7f5670157f30 2024-09-21T07:01:04.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:04.830+0000 7f56782dc640 1 -- 172.21.15.63:0/506391310 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5670070dd0 con 0x7f5670157f30 2024-09-21T07:01:05.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.785+0000 7f5666ffd640 1 -- 172.21.15.63:0/506391310 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f5668063970 con 0x7f5670157f30 2024-09-21T07:01:05.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.788+0000 7f56782dc640 1 -- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5654078bc0 msgr2=0x7f565407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:05.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.788+0000 7f56782dc640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5654078bc0 0x7f565407b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f566c035000 tx=0x7f566c0046c0 comp rx=0 tx=0).stop 2024-09-21T07:01:05.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.788+0000 7f56782dc640 1 -- 172.21.15.63:0/506391310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5670157f30 msgr2=0x7f567015c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:05.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.788+0000 7f56782dc640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5670157f30 0x7f567015c190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5668000f80 tx=0x7f5668006720 comp rx=0 tx=0).stop 2024-09-21T07:01:05.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.788+0000 7f56782dc640 1 -- 172.21.15.63:0/506391310 shutdown_connections 2024-09-21T07:01:05.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.788+0000 7f56782dc640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5654078bc0 0x7f565407b0d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.788+0000 7f56782dc640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5670157f30 0x7f567015c190 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.788+0000 7f56782dc640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f56701f3ff0 0x7f56700ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.788+0000 7f56782dc640 1 --2- 172.21.15.63:0/506391310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f565c003ae0 0x7f567009ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.788+0000 7f56782dc640 1 -- 172.21.15.63:0/506391310 >> 172.21.15.63:0/506391310 conn(0x7f56700b2f70 msgr2=0x7f5670158ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.788+0000 7f56782dc640 1 -- 172.21.15.63:0/506391310 shutdown_connections 2024-09-21T07:01:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.788+0000 7f56782dc640 1 -- 172.21.15.63:0/506391310 wait complete. 2024-09-21T07:01:05.804 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-21T07:01:05.804 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-21T07:01:05.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.930+0000 7f1c54c2e640 1 -- 172.21.15.63:0/518721887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c38004d40 msgr2=0x7f1c38005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:05.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.930+0000 7f1c54c2e640 1 --2- 172.21.15.63:0/518721887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c38004d40 0x7f1c38005150 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800c260 tx=0x7f1c38005830 comp rx=0 tx=0).stop 2024-09-21T07:01:05.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.930+0000 7f1c4ed9d640 1 -- 172.21.15.63:0/518721887 reap_dead start 2024-09-21T07:01:05.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.930+0000 7f1c54c2e640 1 -- 172.21.15.63:0/518721887 shutdown_connections 2024-09-21T07:01:05.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.930+0000 7f1c54c2e640 1 -- 172.21.15.63:0/518721887 >> 172.21.15.63:0/518721887 conn(0x7f1c500b3fb0 msgr2=0x7f1c500b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:05.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.930+0000 7f1c54c2e640 1 -- 172.21.15.63:0/518721887 shutdown_connections 2024-09-21T07:01:05.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.930+0000 7f1c54c2e640 1 -- 172.21.15.63:0/518721887 wait complete. 2024-09-21T07:01:05.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.932+0000 7f1c54c2e640 1 Processor -- start 2024-09-21T07:01:05.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.932+0000 7f1c54c2e640 1 -- start start 2024-09-21T07:01:05.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.933+0000 7f1c54c2e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c38004d40 0x7f1c50159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:05.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.933+0000 7f1c54c2e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1c50148470 0x7f1c5009d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:05.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.933+0000 7f1c54c2e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c50148cc0 0x7f1c501490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:05.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.933+0000 7f1c54c2e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1c500b7230 con 0x7f1c38004d40 2024-09-21T07:01:05.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.933+0000 7f1c54c2e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1c500b70b0 con 0x7f1c50148cc0 2024-09-21T07:01:05.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.933+0000 7f1c54c2e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1c500cdd30 con 0x7f1c50148470 2024-09-21T07:01:05.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.933+0000 7f1c4e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c38004d40 0x7f1c50159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.933+0000 7f1c4e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c38004d40 0x7f1c50159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39016/0 (socket says 172.21.15.63:39016) 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.933+0000 7f1c4e59c640 1 -- 172.21.15.63:0/125372745 learned_addr learned my addr 172.21.15.63:0/125372745 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c4dd9b640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1c50148470 0x7f1c5009d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c4ed9d640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c50148cc0 0x7f1c501490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c4e59c640 1 -- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1c50148470 msgr2=0x7f1c5009d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c4e59c640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1c50148470 0x7f1c5009d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c4e59c640 1 -- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c50148cc0 msgr2=0x7f1c501490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c4e59c640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c50148cc0 0x7f1c501490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c4e59c640 1 -- 172.21.15.63:0/125372745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c501f8050 con 0x7f1c38004d40 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c4ed9d640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c50148cc0 0x7f1c501490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c4e59c640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c38004d40 0x7f1c50159b60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1c40011d90 tx=0x7f1c4000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c3effd640 1 -- 172.21.15.63:0/125372745 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40003d80 con 0x7f1c38004d40 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c3effd640 1 -- 172.21.15.63:0/125372745 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c40004b20 con 0x7f1c38004d40 2024-09-21T07:01:05.937 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c54c2e640 1 -- 172.21.15.63:0/125372745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c500af5b0 con 0x7f1c38004d40 2024-09-21T07:01:05.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c3effd640 1 -- 172.21.15.63:0/125372745 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40004050 con 0x7f1c38004d40 2024-09-21T07:01:05.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.934+0000 7f1c54c2e640 1 -- 172.21.15.63:0/125372745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c50159360 con 0x7f1c38004d40 2024-09-21T07:01:05.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.935+0000 7f1c54c2e640 1 -- 172.21.15.63:0/125372745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c5009aa40 con 0x7f1c38004d40 2024-09-21T07:01:05.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.936+0000 7f1c3effd640 1 -- 172.21.15.63:0/125372745 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c400041f0 con 0x7f1c38004d40 2024-09-21T07:01:05.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.936+0000 7f1c3effd640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1c30078b90 0x7f1c3007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:05.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.937+0000 7f1c3effd640 1 -- 172.21.15.63:0/125372745 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1c4009be10 con 0x7f1c38004d40 2024-09-21T07:01:05.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.937+0000 7f1c4dd9b640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1c30078b90 0x7f1c3007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:05.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.937+0000 7f1c4dd9b640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1c30078b90 0x7f1c3007b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c5015a740 tx=0x7f1c44005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:05.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:05.941+0000 7f1c3effd640 1 -- 172.21.15.63:0/125372745 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1c501f8050 con 0x7f1c38004d40 2024-09-21T07:01:06.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.168+0000 7f1c54c2e640 1 -- 172.21.15.63:0/125372745 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1c5006a130 con 0x7f1c38004d40 2024-09-21T07:01:06.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.790+0000 7f1c3effd640 1 -- 172.21.15.63:0/125372745 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f1c40064370 con 0x7f1c38004d40 2024-09-21T07:01:06.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.793+0000 7f1c54c2e640 1 -- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1c30078b90 msgr2=0x7f1c3007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.793+0000 7f1c54c2e640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1c30078b90 0x7f1c3007b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c5015a740 tx=0x7f1c44005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:06.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.793+0000 7f1c54c2e640 1 -- 172.21.15.63:0/125372745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c38004d40 msgr2=0x7f1c50159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.793+0000 7f1c54c2e640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c38004d40 0x7f1c50159b60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1c40011d90 tx=0x7f1c4000f790 comp rx=0 tx=0).stop 2024-09-21T07:01:06.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.793+0000 7f1c54c2e640 1 -- 172.21.15.63:0/125372745 shutdown_connections 2024-09-21T07:01:06.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.793+0000 7f1c54c2e640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1c30078b90 0x7f1c3007b0a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.793+0000 7f1c54c2e640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c50148cc0 0x7f1c501490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.793+0000 7f1c54c2e640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1c50148470 0x7f1c5009d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.793+0000 7f1c54c2e640 1 --2- 172.21.15.63:0/125372745 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1c38004d40 0x7f1c50159b60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.793+0000 7f1c54c2e640 1 -- 172.21.15.63:0/125372745 >> 172.21.15.63:0/125372745 conn(0x7f1c500b3fb0 msgr2=0x7f1c50071220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:06.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.793+0000 7f1c54c2e640 1 -- 172.21.15.63:0/125372745 shutdown_connections 2024-09-21T07:01:06.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.793+0000 7f1c54c2e640 1 -- 172.21.15.63:0/125372745 wait complete. 2024-09-21T07:01:06.808 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-21T07:01:06.809 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:01:06.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.927+0000 7fe0d7fff640 1 -- 172.21.15.63:0/3719676635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d80cfd70 msgr2=0x7fe0d8162c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.927+0000 7fe0d7fff640 1 --2- 172.21.15.63:0/3719676635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d80cfd70 0x7fe0d8162c00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009830 tx=0x7fe0c802a480 comp rx=0 tx=0).stop 2024-09-21T07:01:06.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.927+0000 7fe0d7fff640 1 -- 172.21.15.63:0/3719676635 shutdown_connections 2024-09-21T07:01:06.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.927+0000 7fe0d7fff640 1 --2- 172.21.15.63:0/3719676635 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0d8163140 0x7fe0d80d27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.927+0000 7fe0d7fff640 1 --2- 172.21.15.63:0/3719676635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d80cfd70 0x7fe0d8162c00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.927+0000 7fe0d7fff640 1 -- 172.21.15.63:0/3719676635 >> 172.21.15.63:0/3719676635 conn(0x7fe0d806dde0 msgr2=0x7fe0d806e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:06.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.927+0000 7fe0d7fff640 1 -- 172.21.15.63:0/3719676635 shutdown_connections 2024-09-21T07:01:06.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.927+0000 7fe0d7fff640 1 -- 172.21.15.63:0/3719676635 wait complete. 2024-09-21T07:01:06.930 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.929+0000 7fe0d7fff640 1 Processor -- start 2024-09-21T07:01:06.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.929+0000 7fe0d7fff640 1 -- start start 2024-09-21T07:01:06.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.930+0000 7fe0d7fff640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0d80cfd70 0x7fe0d80ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:06.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.930+0000 7fe0d7fff640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d80d2d30 0x7fe0d80b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:06.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.930+0000 7fe0d7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d8163140 0x7fe0d815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.930+0000 7fe0d7fff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d815eb10 con 0x7fe0d8163140 2024-09-21T07:01:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.930+0000 7fe0d7fff640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d815e990 con 0x7fe0d80d2d30 2024-09-21T07:01:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.930+0000 7fe0d7fff640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d815ec90 con 0x7fe0d80cfd70 2024-09-21T07:01:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.930+0000 7fe0d77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d8163140 0x7fe0d815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.930+0000 7fe0d77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d8163140 0x7fe0d815ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39024/0 (socket says 172.21.15.63:39024) 2024-09-21T07:01:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.930+0000 7fe0d77fe640 1 -- 172.21.15.63:0/2514769490 learned_addr learned my addr 172.21.15.63:0/2514769490 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.931+0000 7fe0d67fc640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d80d2d30 0x7fe0d80b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.931+0000 7fe0d6ffd640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0d80cfd70 0x7fe0d80ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.931+0000 7fe0d77fe640 1 -- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0d80cfd70 msgr2=0x7fe0d80ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.931+0000 7fe0d77fe640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0d80cfd70 0x7fe0d80ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.931+0000 7fe0d77fe640 1 -- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d80d2d30 msgr2=0x7fe0d80b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.931+0000 7fe0d77fe640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d80d2d30 0x7fe0d80b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:06.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.931+0000 7fe0d77fe640 1 -- 172.21.15.63:0/2514769490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d81f55e0 con 0x7fe0d8163140 2024-09-21T07:01:06.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.931+0000 7fe0d77fe640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d8163140 0x7fe0d815ab00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0002230 tx=0x7fe0d000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:06.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.931+0000 7fe0cf7fe640 1 -- 172.21.15.63:0/2514769490 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0016020 con 0x7fe0d8163140 2024-09-21T07:01:06.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.931+0000 7fe0cf7fe640 1 -- 172.21.15.63:0/2514769490 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0d000ad20 con 0x7fe0d8163140 2024-09-21T07:01:06.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.931+0000 7fe0d7fff640 1 -- 172.21.15.63:0/2514769490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d80c94d0 con 0x7fe0d8163140 2024-09-21T07:01:06.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.931+0000 7fe0cf7fe640 1 -- 172.21.15.63:0/2514769490 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0012680 con 0x7fe0d8163140 2024-09-21T07:01:06.935 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.931+0000 7fe0d7fff640 1 -- 172.21.15.63:0/2514769490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d81f9600 con 0x7fe0d8163140 2024-09-21T07:01:06.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.932+0000 7fe0d7fff640 1 -- 172.21.15.63:0/2514769490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d81f9090 con 0x7fe0d8163140 2024-09-21T07:01:06.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.933+0000 7fe0cf7fe640 1 -- 172.21.15.63:0/2514769490 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe0d0019020 con 0x7fe0d8163140 2024-09-21T07:01:06.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.934+0000 7fe0cf7fe640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe0b8078bc0 0x7fe0b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:06.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.934+0000 7fe0cf7fe640 1 -- 172.21.15.63:0/2514769490 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe0d009aec0 con 0x7fe0d8163140 2024-09-21T07:01:06.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.934+0000 7fe0d6ffd640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe0b8078bc0 0x7fe0b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:06.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.935+0000 7fe0d6ffd640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe0b8078bc0 0x7fe0b807b0d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8034000 tx=0x7fe0c8004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:06.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:06.938+0000 7fe0cf7fe640 1 -- 172.21.15.63:0/2514769490 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe0d0020030 con 0x7fe0d8163140 2024-09-21T07:01:07.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.165+0000 7fe0d7fff640 1 -- 172.21.15.63:0/2514769490 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0d815f140 con 0x7fe0d8163140 2024-09-21T07:01:07.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.166+0000 7fe0cf7fe640 1 -- 172.21.15.63:0/2514769490 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5220 (secure 0 0 0) 0x7fe0d0062cb0 con 0x7fe0d8163140 2024-09-21T07:01:07.167 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:07.168 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"btime":"2024-09-21T07:01:06:786372+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/585708774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":585708774},{"type":"v1","addr":"172.21.15.71:6836","nonce":585708774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4837,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2545148827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":2545148827},{"type":"v1","addr":"172.21.15.71:6837","nonce":2545148827}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/2618757202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2618757202},{"type":"v1","addr":"172.21.15.63:6834","nonce":2618757202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:01:03.150809+0000","modified":"2024-09-21T07:01:06.170075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6835/3748950985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":3748950985},{"type":"v1","addr":"172.21.15.63:6835","nonce":3748950985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4905,"qdb_cluster":[4905]},"id":2}]} 2024-09-21T07:01:07.168 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2024-09-21T07:01:07.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.168+0000 7fe0d7fff640 1 -- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe0b8078bc0 msgr2=0x7fe0b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.168+0000 7fe0d7fff640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe0b8078bc0 0x7fe0b807b0d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8034000 tx=0x7fe0c8004730 comp rx=0 tx=0).stop 2024-09-21T07:01:07.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.168+0000 7fe0d7fff640 1 -- 172.21.15.63:0/2514769490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d8163140 msgr2=0x7fe0d815ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.168+0000 7fe0d7fff640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d8163140 0x7fe0d815ab00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0002230 tx=0x7fe0d000cf70 comp rx=0 tx=0).stop 2024-09-21T07:01:07.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.168+0000 7fe0d7fff640 1 -- 172.21.15.63:0/2514769490 shutdown_connections 2024-09-21T07:01:07.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.168+0000 7fe0d7fff640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe0b8078bc0 0x7fe0b807b0d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.168+0000 7fe0d7fff640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0d8163140 0x7fe0d815ab00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.168+0000 7fe0d7fff640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe0d80d2d30 0x7fe0d80b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.168+0000 7fe0d7fff640 1 --2- 172.21.15.63:0/2514769490 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe0d80cfd70 0x7fe0d80ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.168+0000 7fe0d7fff640 1 -- 172.21.15.63:0/2514769490 >> 172.21.15.63:0/2514769490 conn(0x7fe0d806dde0 msgr2=0x7fe0d815db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:07.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.168+0000 7fe0d7fff640 1 -- 172.21.15.63:0/2514769490 shutdown_connections 2024-09-21T07:01:07.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.168+0000 7fe0d7fff640 1 -- 172.21.15.63:0/2514769490 wait complete. 2024-09-21T07:01:07.181 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:01:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.296+0000 7fae021df640 1 -- 172.21.15.63:0/613972912 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fadfc153900 msgr2=0x7fadfc06f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.296+0000 7fae021df640 1 --2- 172.21.15.63:0/613972912 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fadfc153900 0x7fadfc06f850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009860 tx=0x7fadf002a530 comp rx=0 tx=0).stop 2024-09-21T07:01:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.297+0000 7fae021df640 1 -- 172.21.15.63:0/613972912 shutdown_connections 2024-09-21T07:01:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.297+0000 7fae021df640 1 --2- 172.21.15.63:0/613972912 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fadfc153900 0x7fadfc06f850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.297+0000 7fae021df640 1 -- 172.21.15.63:0/613972912 >> 172.21.15.63:0/613972912 conn(0x7fadfc0b2790 msgr2=0x7fadfc0b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.297+0000 7fae021df640 1 -- 172.21.15.63:0/613972912 shutdown_connections 2024-09-21T07:01:07.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.297+0000 7fae021df640 1 -- 172.21.15.63:0/613972912 wait complete. 2024-09-21T07:01:07.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.298+0000 7fae021df640 1 Processor -- start 2024-09-21T07:01:07.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.299+0000 7fae021df640 1 -- start start 2024-09-21T07:01:07.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fae021df640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadfc0737f0 0x7fadfc156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fae021df640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadfc0ccf80 0x7fadfc1f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fae021df640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fadfc153900 0x7fadfc154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fae021df640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc15d750 con 0x7fadfc0ccf80 2024-09-21T07:01:07.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fae021df640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc15d5d0 con 0x7fadfc0737f0 2024-09-21T07:01:07.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fae021df640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fadfc15d8d0 con 0x7fadfc153900 2024-09-21T07:01:07.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fadfaffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadfc0ccf80 0x7fadfc1f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fadfaffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadfc0ccf80 0x7fadfc1f3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39040/0 (socket says 172.21.15.63:39040) 2024-09-21T07:01:07.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fadfaffd640 1 -- 172.21.15.63:0/3129207635 learned_addr learned my addr 172.21.15.63:0/3129207635 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:07.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fadfb7fe640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadfc0737f0 0x7fadfc156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fadfbfff640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fadfc153900 0x7fadfc154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fadfaffd640 1 -- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fadfc153900 msgr2=0x7fadfc154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fadfaffd640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fadfc153900 0x7fadfc154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fadfaffd640 1 -- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadfc0737f0 msgr2=0x7fadfc156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fadfaffd640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadfc0737f0 0x7fadfc156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.300+0000 7fadfaffd640 1 -- 172.21.15.63:0/3129207635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadfc156c60 con 0x7fadfc0ccf80 2024-09-21T07:01:07.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.301+0000 7fadfaffd640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadfc0ccf80 0x7fadfc1f3d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009980 tx=0x7fadf0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:07.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.301+0000 7fade3fff640 1 -- 172.21.15.63:0/3129207635 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0005c90 con 0x7fadfc0ccf80 2024-09-21T07:01:07.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.301+0000 7fade3fff640 1 -- 172.21.15.63:0/3129207635 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadf0005020 con 0x7fadfc0ccf80 2024-09-21T07:01:07.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.301+0000 7fae021df640 1 -- 172.21.15.63:0/3129207635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadfc156f40 con 0x7fadfc0ccf80 2024-09-21T07:01:07.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.301+0000 7fade3fff640 1 -- 172.21.15.63:0/3129207635 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0005410 con 0x7fadfc0ccf80 2024-09-21T07:01:07.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.301+0000 7fae021df640 1 -- 172.21.15.63:0/3129207635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadfc154f40 con 0x7fadfc0ccf80 2024-09-21T07:01:07.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.302+0000 7fae021df640 1 -- 172.21.15.63:0/3129207635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadfc1569d0 con 0x7fadfc0ccf80 2024-09-21T07:01:07.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.303+0000 7fade3fff640 1 -- 172.21.15.63:0/3129207635 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fadf00317c0 con 0x7fadfc0ccf80 2024-09-21T07:01:07.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.303+0000 7fade3fff640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fade8078b90 0x7fade807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.303+0000 7fade3fff640 1 -- 172.21.15.63:0/3129207635 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fadf00bbd30 con 0x7fadfc0ccf80 2024-09-21T07:01:07.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.303+0000 7fadfb7fe640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fade8078b90 0x7fade807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.304+0000 7fadfb7fe640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fade8078b90 0x7fade807b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fadec001120 tx=0x7fadec009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:07.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.308+0000 7fade3fff640 1 -- 172.21.15.63:0/3129207635 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fadf003f030 con 0x7fadfc0ccf80 2024-09-21T07:01:07.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.496+0000 7fae021df640 1 -- 172.21.15.63:0/3129207635 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fadfc15a260 con 0x7fadfc0ccf80 2024-09-21T07:01:07.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.497+0000 7fade3fff640 1 -- 172.21.15.63:0/3129207635 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16621 (secure 0 0 0) 0x7fadf0084180 con 0x7fadfc0ccf80 2024-09-21T07:01:07.499 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:07.499 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":33,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:01:04.763327+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:01:01.276831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T07:01:02.103831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:01:07.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.499+0000 7fae021df640 1 -- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fade8078b90 msgr2=0x7fade807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.499+0000 7fae021df640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fade8078b90 0x7fade807b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fadec001120 tx=0x7fadec009040 comp rx=0 tx=0).stop 2024-09-21T07:01:07.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.499+0000 7fae021df640 1 -- 172.21.15.63:0/3129207635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadfc0ccf80 msgr2=0x7fadfc1f3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.499+0000 7fae021df640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadfc0ccf80 0x7fadfc1f3d00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009980 tx=0x7fadf0003c10 comp rx=0 tx=0).stop 2024-09-21T07:01:07.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.499+0000 7fae021df640 1 -- 172.21.15.63:0/3129207635 shutdown_connections 2024-09-21T07:01:07.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.499+0000 7fae021df640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fade8078b90 0x7fade807b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.499+0000 7fae021df640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fadfc153900 0x7fadfc154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.499+0000 7fae021df640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadfc0ccf80 0x7fadfc1f3d00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.500+0000 7fae021df640 1 --2- 172.21.15.63:0/3129207635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fadfc0737f0 0x7fadfc156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.500+0000 7fae021df640 1 -- 172.21.15.63:0/3129207635 >> 172.21.15.63:0/3129207635 conn(0x7fadfc0b2790 msgr2=0x7fadfc0d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:07.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.500+0000 7fae021df640 1 -- 172.21.15.63:0/3129207635 shutdown_connections 2024-09-21T07:01:07.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.500+0000 7fae021df640 1 -- 172.21.15.63:0/3129207635 wait complete. 2024-09-21T07:01:07.513 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:01:07.513 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:01:07.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.628+0000 7fc9b6b33640 1 -- 172.21.15.63:0/473211958 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9b00b9aa0 msgr2=0x7fc9b00d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.628+0000 7fc9b6b33640 1 --2- 172.21.15.63:0/473211958 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9b00b9aa0 0x7fc9b00d0bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009830 tx=0x7fc9a402a480 comp rx=0 tx=0).stop 2024-09-21T07:01:07.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.628+0000 7fc9b6b33640 1 -- 172.21.15.63:0/473211958 shutdown_connections 2024-09-21T07:01:07.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.628+0000 7fc9b6b33640 1 --2- 172.21.15.63:0/473211958 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9b00b9aa0 0x7fc9b00d0bf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.628+0000 7fc9b6b33640 1 --2- 172.21.15.63:0/473211958 >> v2:172.21.15.71:3300/0 conn(0x7fc9b00b3aa0 0x7fc9b00d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.628+0000 7fc9b6b33640 1 -- 172.21.15.63:0/473211958 >> 172.21.15.63:0/473211958 conn(0x7fc9b00d45e0 msgr2=0x7fc9b00d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:07.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.628+0000 7fc9b6b33640 1 -- 172.21.15.63:0/473211958 shutdown_connections 2024-09-21T07:01:07.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.628+0000 7fc9b6b33640 1 -- 172.21.15.63:0/473211958 wait complete. 2024-09-21T07:01:07.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.629+0000 7fc9b6b33640 1 Processor -- start 2024-09-21T07:01:07.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.630+0000 7fc9b6b33640 1 -- start start 2024-09-21T07:01:07.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9b6b33640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9b008c960 0x7fc9b01f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9b6b33640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b00b3aa0 0x7fc9b015d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9b6b33640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9b00b9aa0 0x7fc9b00ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9b6b33640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b006f1c0 con 0x7fc9b00b3aa0 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9b6b33640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b006f040 con 0x7fc9b00b9aa0 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9b6b33640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b006f340 con 0x7fc9b008c960 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9affff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b00b3aa0 0x7fc9b015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9affff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b00b3aa0 0x7fc9b015d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39052/0 (socket says 172.21.15.63:39052) 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9affff640 1 -- 172.21.15.63:0/982475063 learned_addr learned my addr 172.21.15.63:0/982475063 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9b50d0640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9b00b9aa0 0x7fc9b00ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9b48cf640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9b008c960 0x7fc9b01f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9affff640 1 -- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9b008c960 msgr2=0x7fc9b01f6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9affff640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9b008c960 0x7fc9b01f6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9affff640 1 -- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9b00b9aa0 msgr2=0x7fc9b00ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9affff640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9b00b9aa0 0x7fc9b00ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.631+0000 7fc9affff640 1 -- 172.21.15.63:0/982475063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b015ad80 con 0x7fc9b00b3aa0 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.632+0000 7fc9affff640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b00b3aa0 0x7fc9b015d280 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009950 tx=0x7fc9a4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:07.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.632+0000 7fc9ad7fa640 1 -- 172.21.15.63:0/982475063 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4005c90 con 0x7fc9b00b3aa0 2024-09-21T07:01:07.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.632+0000 7fc9ad7fa640 1 -- 172.21.15.63:0/982475063 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9a4031e50 con 0x7fc9b00b3aa0 2024-09-21T07:01:07.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.632+0000 7fc9b6b33640 1 -- 172.21.15.63:0/982475063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b015b060 con 0x7fc9b00b3aa0 2024-09-21T07:01:07.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.632+0000 7fc9ad7fa640 1 -- 172.21.15.63:0/982475063 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4005260 con 0x7fc9b00b3aa0 2024-09-21T07:01:07.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.632+0000 7fc9b6b33640 1 -- 172.21.15.63:0/982475063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b015ca80 con 0x7fc9b00b3aa0 2024-09-21T07:01:07.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.633+0000 7fc9b6b33640 1 -- 172.21.15.63:0/982475063 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b00d13d0 con 0x7fc9b00b3aa0 2024-09-21T07:01:07.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.634+0000 7fc9ad7fa640 1 -- 172.21.15.63:0/982475063 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9a4005400 con 0x7fc9b00b3aa0 2024-09-21T07:01:07.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.634+0000 7fc9ad7fa640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc99c078b90 0x7fc99c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:07.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.634+0000 7fc9ad7fa640 1 -- 172.21.15.63:0/982475063 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc9a40bbce0 con 0x7fc9b00b3aa0 2024-09-21T07:01:07.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.635+0000 7fc9b48cf640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc99c078b90 0x7fc99c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:07.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.635+0000 7fc9b48cf640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc99c078b90 0x7fc99c07b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8005fd0 tx=0x7fc9a80094a0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:07.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.639+0000 7fc9ad7fa640 1 -- 172.21.15.63:0/982475063 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc9a403f030 con 0x7fc9b00b3aa0 2024-09-21T07:01:07.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.823+0000 7fc9b6b33640 1 -- 172.21.15.63:0/982475063 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc9b006fb60 con 0x7fc99c078b90 2024-09-21T07:01:07.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.828+0000 7fc9ad7fa640 1 -- 172.21.15.63:0/982475063 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249933 (secure 0 0 0) 0x7fc9b006fb60 con 0x7fc99c078b90 2024-09-21T07:01:07.832 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:07.834 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:01:07.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.831+0000 7fc9b6b33640 1 -- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc99c078b90 msgr2=0x7fc99c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.831+0000 7fc9b6b33640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc99c078b90 0x7fc99c07b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8005fd0 tx=0x7fc9a80094a0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.831+0000 7fc9b6b33640 1 -- 172.21.15.63:0/982475063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b00b3aa0 msgr2=0x7fc9b015d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:07.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.831+0000 7fc9b6b33640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b00b3aa0 0x7fc9b015d280 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009950 tx=0x7fc9a4033c20 comp rx=0 tx=0).stop 2024-09-21T07:01:07.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.831+0000 7fc9b6b33640 1 -- 172.21.15.63:0/982475063 shutdown_connections 2024-09-21T07:01:07.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.831+0000 7fc9b6b33640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc99c078b90 0x7fc99c07b0a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.831+0000 7fc9b6b33640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc9b00b9aa0 0x7fc9b00ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.831+0000 7fc9b6b33640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc9b00b3aa0 0x7fc9b015d280 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.831+0000 7fc9b6b33640 1 --2- 172.21.15.63:0/982475063 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc9b008c960 0x7fc9b01f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:07.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.831+0000 7fc9b6b33640 1 -- 172.21.15.63:0/982475063 >> 172.21.15.63:0/982475063 conn(0x7fc9b00d45e0 msgr2=0x7fc9b0075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:07.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.831+0000 7fc9b6b33640 1 -- 172.21.15.63:0/982475063 shutdown_connections 2024-09-21T07:01:07.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:07.831+0000 7fc9b6b33640 1 -- 172.21.15.63:0/982475063 wait complete. 2024-09-21T07:01:07.844 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-21T07:01:06.608025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":142,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220224,"kb_used_data":3960,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754496,"statfs":{"total":773094113280,"available":772868603904,"internally_reserved":0,"allocated":4055040,"data_stored":2251184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,11],"upper_bound":32},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.847185"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844066+0000","last_change":"2024-09-21T07:01:03.794142+0000","last_active":"2024-09-21T07:01:04.844066+0000","last_peered":"2024-09-21T07:01:04.844066+0000","last_clean":"2024-09-21T07:01:04.844066+0000","last_became_active":"2024-09-21T07:01:03.790316+0000","last_became_peered":"2024-09-21T07:01:03.790316+0000","last_unstale":"2024-09-21T07:01:04.844066+0000","last_undegraded":"2024-09-21T07:01:04.844066+0000","last_fullsized":"2024-09-21T07:01:04.844066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:19.787933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844566+0000","last_change":"2024-09-21T07:01:03.791660+0000","last_active":"2024-09-21T07:01:04.844566+0000","last_peered":"2024-09-21T07:01:04.844566+0000","last_clean":"2024-09-21T07:01:04.844566+0000","last_became_active":"2024-09-21T07:01:03.790741+0000","last_became_peered":"2024-09-21T07:01:03.790741+0000","last_unstale":"2024-09-21T07:01:04.844566+0000","last_undegraded":"2024-09-21T07:01:04.844566+0000","last_fullsized":"2024-09-21T07:01:04.844566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.262768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768560+0000","last_change":"2024-09-21T07:01:03.792492+0000","last_active":"2024-09-21T07:01:04.768560+0000","last_peered":"2024-09-21T07:01:04.768560+0000","last_clean":"2024-09-21T07:01:04.768560+0000","last_became_active":"2024-09-21T07:01:03.792164+0000","last_became_peered":"2024-09-21T07:01:03.792164+0000","last_unstale":"2024-09-21T07:01:04.768560+0000","last_undegraded":"2024-09-21T07:01:04.768560+0000","last_fullsized":"2024-09-21T07:01:04.768560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:38.201057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843541+0000","last_change":"2024-09-21T07:01:03.775605+0000","last_active":"2024-09-21T07:01:04.843541+0000","last_peered":"2024-09-21T07:01:04.843541+0000","last_clean":"2024-09-21T07:01:04.843541+0000","last_became_active":"2024-09-21T07:01:03.775096+0000","last_became_peered":"2024-09-21T07:01:03.775096+0000","last_unstale":"2024-09-21T07:01:04.843541+0000","last_undegraded":"2024-09-21T07:01:04.843541+0000","last_fullsized":"2024-09-21T07:01:04.843541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:23.836413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844759+0000","last_change":"2024-09-21T07:01:03.801253+0000","last_active":"2024-09-21T07:01:04.844759+0000","last_peered":"2024-09-21T07:01:04.844759+0000","last_clean":"2024-09-21T07:01:04.844759+0000","last_became_active":"2024-09-21T07:01:03.800920+0000","last_became_peered":"2024-09-21T07:01:03.800920+0000","last_unstale":"2024-09-21T07:01:04.844759+0000","last_undegraded":"2024-09-21T07:01:04.844759+0000","last_fullsized":"2024-09-21T07:01:04.844759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:42.751536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843408+0000","last_change":"2024-09-21T07:01:03.795428+0000","last_active":"2024-09-21T07:01:04.843408+0000","last_peered":"2024-09-21T07:01:04.843408+0000","last_clean":"2024-09-21T07:01:04.843408+0000","last_became_active":"2024-09-21T07:01:03.795098+0000","last_became_peered":"2024-09-21T07:01:03.795098+0000","last_unstale":"2024-09-21T07:01:04.843408+0000","last_undegraded":"2024-09-21T07:01:04.843408+0000","last_fullsized":"2024-09-21T07:01:04.843408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843685+0000","last_change":"2024-09-21T07:01:03.795965+0000","last_active":"2024-09-21T07:01:04.843685+0000","last_peered":"2024-09-21T07:01:04.843685+0000","last_clean":"2024-09-21T07:01:04.843685+0000","last_became_active":"2024-09-21T07:01:03.795485+0000","last_became_peered":"2024-09-21T07:01:03.795485+0000","last_unstale":"2024-09-21T07:01:04.843685+0000","last_undegraded":"2024-09-21T07:01:04.843685+0000","last_fullsized":"2024-09-21T07:01:04.843685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:45.129827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768692+0000","last_change":"2024-09-21T07:01:03.797379+0000","last_active":"2024-09-21T07:01:04.768692+0000","last_peered":"2024-09-21T07:01:04.768692+0000","last_clean":"2024-09-21T07:01:04.768692+0000","last_became_active":"2024-09-21T07:01:03.797038+0000","last_became_peered":"2024-09-21T07:01:03.797038+0000","last_unstale":"2024-09-21T07:01:04.768692+0000","last_undegraded":"2024-09-21T07:01:04.768692+0000","last_fullsized":"2024-09-21T07:01:04.768692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.981958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843680+0000","last_change":"2024-09-21T07:01:03.797615+0000","last_active":"2024-09-21T07:01:04.843680+0000","last_peered":"2024-09-21T07:01:04.843680+0000","last_clean":"2024-09-21T07:01:04.843680+0000","last_became_active":"2024-09-21T07:01:03.796962+0000","last_became_peered":"2024-09-21T07:01:03.796962+0000","last_unstale":"2024-09-21T07:01:04.843680+0000","last_undegraded":"2024-09-21T07:01:04.843680+0000","last_fullsized":"2024-09-21T07:01:04.843680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:29.202843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768150+0000","last_change":"2024-09-21T07:01:03.788053+0000","last_active":"2024-09-21T07:01:04.768150+0000","last_peered":"2024-09-21T07:01:04.768150+0000","last_clean":"2024-09-21T07:01:04.768150+0000","last_became_active":"2024-09-21T07:01:03.787728+0000","last_became_peered":"2024-09-21T07:01:03.787728+0000","last_unstale":"2024-09-21T07:01:04.768150+0000","last_undegraded":"2024-09-21T07:01:04.768150+0000","last_fullsized":"2024-09-21T07:01:04.768150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:44.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844461+0000","last_change":"2024-09-21T07:01:03.792564+0000","last_active":"2024-09-21T07:01:04.844461+0000","last_peered":"2024-09-21T07:01:04.844461+0000","last_clean":"2024-09-21T07:01:04.844461+0000","last_became_active":"2024-09-21T07:01:03.791629+0000","last_became_peered":"2024-09-21T07:01:03.791629+0000","last_unstale":"2024-09-21T07:01:04.844461+0000","last_undegraded":"2024-09-21T07:01:04.844461+0000","last_fullsized":"2024-09-21T07:01:04.844461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:58.610632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767157+0000","last_change":"2024-09-21T07:01:03.801933+0000","last_active":"2024-09-21T07:01:04.767157+0000","last_peered":"2024-09-21T07:01:04.767157+0000","last_clean":"2024-09-21T07:01:04.767157+0000","last_became_active":"2024-09-21T07:01:03.801563+0000","last_became_peered":"2024-09-21T07:01:03.801563+0000","last_unstale":"2024-09-21T07:01:04.767157+0000","last_undegraded":"2024-09-21T07:01:04.767157+0000","last_fullsized":"2024-09-21T07:01:04.767157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:34.894160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767121+0000","last_change":"2024-09-21T07:01:03.787523+0000","last_active":"2024-09-21T07:01:04.767121+0000","last_peered":"2024-09-21T07:01:04.767121+0000","last_clean":"2024-09-21T07:01:04.767121+0000","last_became_active":"2024-09-21T07:01:03.786731+0000","last_became_peered":"2024-09-21T07:01:03.786731+0000","last_unstale":"2024-09-21T07:01:04.767121+0000","last_undegraded":"2024-09-21T07:01:04.767121+0000","last_fullsized":"2024-09-21T07:01:04.767121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:11.993232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843403+0000","last_change":"2024-09-21T07:01:03.799976+0000","last_active":"2024-09-21T07:01:04.843403+0000","last_peered":"2024-09-21T07:01:04.843403+0000","last_clean":"2024-09-21T07:01:04.843403+0000","last_became_active":"2024-09-21T07:01:03.799425+0000","last_became_peered":"2024-09-21T07:01:03.799425+0000","last_unstale":"2024-09-21T07:01:04.843403+0000","last_undegraded":"2024-09-21T07:01:04.843403+0000","last_fullsized":"2024-09-21T07:01:04.843403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:37.275079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844401+0000","last_change":"2024-09-21T07:01:03.781832+0000","last_active":"2024-09-21T07:01:04.844401+0000","last_peered":"2024-09-21T07:01:04.844401+0000","last_clean":"2024-09-21T07:01:04.844401+0000","last_became_active":"2024-09-21T07:01:03.779709+0000","last_became_peered":"2024-09-21T07:01:03.779709+0000","last_unstale":"2024-09-21T07:01:04.844401+0000","last_undegraded":"2024-09-21T07:01:04.844401+0000","last_fullsized":"2024-09-21T07:01:04.844401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:04.995003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844689+0000","last_change":"2024-09-21T07:01:03.788320+0000","last_active":"2024-09-21T07:01:04.844689+0000","last_peered":"2024-09-21T07:01:04.844689+0000","last_clean":"2024-09-21T07:01:04.844689+0000","last_became_active":"2024-09-21T07:01:03.787978+0000","last_became_peered":"2024-09-21T07:01:03.787978+0000","last_unstale":"2024-09-21T07:01:04.844689+0000","last_undegraded":"2024-09-21T07:01:04.844689+0000","last_fullsized":"2024-09-21T07:01:04.844689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:18.875542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844064+0000","last_change":"2024-09-21T07:01:03.792145+0000","last_active":"2024-09-21T07:01:04.844064+0000","last_peered":"2024-09-21T07:01:04.844064+0000","last_clean":"2024-09-21T07:01:04.844064+0000","last_became_active":"2024-09-21T07:01:03.791766+0000","last_became_peered":"2024-09-21T07:01:03.791766+0000","last_unstale":"2024-09-21T07:01:04.844064+0000","last_undegraded":"2024-09-21T07:01:04.844064+0000","last_fullsized":"2024-09-21T07:01:04.844064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:45.001116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767414+0000","last_change":"2024-09-21T07:01:03.788762+0000","last_active":"2024-09-21T07:01:04.767414+0000","last_peered":"2024-09-21T07:01:04.767414+0000","last_clean":"2024-09-21T07:01:04.767414+0000","last_became_active":"2024-09-21T07:01:03.788372+0000","last_became_peered":"2024-09-21T07:01:03.788372+0000","last_unstale":"2024-09-21T07:01:04.767414+0000","last_undegraded":"2024-09-21T07:01:04.767414+0000","last_fullsized":"2024-09-21T07:01:04.767414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:19.787933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843211+0000","last_change":"2024-09-21T07:01:03.799507+0000","last_active":"2024-09-21T07:01:04.843211+0000","last_peered":"2024-09-21T07:01:04.843211+0000","last_clean":"2024-09-21T07:01:04.843211+0000","last_became_active":"2024-09-21T07:01:03.798713+0000","last_became_peered":"2024-09-21T07:01:03.798713+0000","last_unstale":"2024-09-21T07:01:04.843211+0000","last_undegraded":"2024-09-21T07:01:04.843211+0000","last_fullsized":"2024-09-21T07:01:04.843211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:42.573263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843765+0000","last_change":"2024-09-21T07:01:03.781265+0000","last_active":"2024-09-21T07:01:04.843765+0000","last_peered":"2024-09-21T07:01:04.843765+0000","last_clean":"2024-09-21T07:01:04.843765+0000","last_became_active":"2024-09-21T07:01:03.780969+0000","last_became_peered":"2024-09-21T07:01:03.780969+0000","last_unstale":"2024-09-21T07:01:04.843765+0000","last_undegraded":"2024-09-21T07:01:04.843765+0000","last_fullsized":"2024-09-21T07:01:04.843765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:59.851233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843141+0000","last_change":"2024-09-21T07:01:03.799128+0000","last_active":"2024-09-21T07:01:04.843141+0000","last_peered":"2024-09-21T07:01:04.843141+0000","last_clean":"2024-09-21T07:01:04.843141+0000","last_became_active":"2024-09-21T07:01:03.798706+0000","last_became_peered":"2024-09-21T07:01:03.798706+0000","last_unstale":"2024-09-21T07:01:04.843141+0000","last_undegraded":"2024-09-21T07:01:04.843141+0000","last_fullsized":"2024-09-21T07:01:04.843141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:56.371767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844561+0000","last_change":"2024-09-21T07:01:03.789643+0000","last_active":"2024-09-21T07:01:04.844561+0000","last_peered":"2024-09-21T07:01:04.844561+0000","last_clean":"2024-09-21T07:01:04.844561+0000","last_became_active":"2024-09-21T07:01:03.789249+0000","last_became_peered":"2024-09-21T07:01:03.789249+0000","last_unstale":"2024-09-21T07:01:04.844561+0000","last_undegraded":"2024-09-21T07:01:04.844561+0000","last_fullsized":"2024-09-21T07:01:04.844561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:24.747636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844048+0000","last_change":"2024-09-21T07:01:03.793850+0000","last_active":"2024-09-21T07:01:04.844048+0000","last_peered":"2024-09-21T07:01:04.844048+0000","last_clean":"2024-09-21T07:01:04.844048+0000","last_became_active":"2024-09-21T07:01:03.790220+0000","last_became_peered":"2024-09-21T07:01:03.790220+0000","last_unstale":"2024-09-21T07:01:04.844048+0000","last_undegraded":"2024-09-21T07:01:04.844048+0000","last_fullsized":"2024-09-21T07:01:04.844048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.262768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767762+0000","last_change":"2024-09-21T07:01:03.802120+0000","last_active":"2024-09-21T07:01:04.767762+0000","last_peered":"2024-09-21T07:01:04.767762+0000","last_clean":"2024-09-21T07:01:04.767762+0000","last_became_active":"2024-09-21T07:01:03.801699+0000","last_became_peered":"2024-09-21T07:01:03.801699+0000","last_unstale":"2024-09-21T07:01:04.767762+0000","last_undegraded":"2024-09-21T07:01:04.767762+0000","last_fullsized":"2024-09-21T07:01:04.767762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:16.741550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767176+0000","last_change":"2024-09-21T07:01:03.779994+0000","last_active":"2024-09-21T07:01:04.767176+0000","last_peered":"2024-09-21T07:01:04.767176+0000","last_clean":"2024-09-21T07:01:04.767176+0000","last_became_active":"2024-09-21T07:01:03.779267+0000","last_became_peered":"2024-09-21T07:01:03.779267+0000","last_unstale":"2024-09-21T07:01:04.767176+0000","last_undegraded":"2024-09-21T07:01:04.767176+0000","last_fullsized":"2024-09-21T07:01:04.767176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:24.747636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843248+0000","last_change":"2024-09-21T07:01:03.799390+0000","last_active":"2024-09-21T07:01:04.843248+0000","last_peered":"2024-09-21T07:01:04.843248+0000","last_clean":"2024-09-21T07:01:04.843248+0000","last_became_active":"2024-09-21T07:01:03.799078+0000","last_became_peered":"2024-09-21T07:01:03.799078+0000","last_unstale":"2024-09-21T07:01:04.843248+0000","last_undegraded":"2024-09-21T07:01:04.843248+0000","last_fullsized":"2024-09-21T07:01:04.843248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:36.565399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843261+0000","last_change":"2024-09-21T07:01:03.800557+0000","last_active":"2024-09-21T07:01:04.843261+0000","last_peered":"2024-09-21T07:01:04.843261+0000","last_clean":"2024-09-21T07:01:04.843261+0000","last_became_active":"2024-09-21T07:01:03.800262+0000","last_became_peered":"2024-09-21T07:01:03.800262+0000","last_unstale":"2024-09-21T07:01:04.843261+0000","last_undegraded":"2024-09-21T07:01:04.843261+0000","last_fullsized":"2024-09-21T07:01:04.843261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:06.031208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844973+0000","last_change":"2024-09-21T07:01:03.781597+0000","last_active":"2024-09-21T07:01:04.844973+0000","last_peered":"2024-09-21T07:01:04.844973+0000","last_clean":"2024-09-21T07:01:04.844973+0000","last_became_active":"2024-09-21T07:01:03.781303+0000","last_became_peered":"2024-09-21T07:01:03.781303+0000","last_unstale":"2024-09-21T07:01:04.844973+0000","last_undegraded":"2024-09-21T07:01:04.844973+0000","last_fullsized":"2024-09-21T07:01:04.844973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:42.573263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843625+0000","last_change":"2024-09-21T07:01:02.778634+0000","last_active":"2024-09-21T07:01:04.843625+0000","last_peered":"2024-09-21T07:01:04.843625+0000","last_clean":"2024-09-21T07:01:04.843625+0000","last_became_active":"2024-09-21T07:01:02.778310+0000","last_became_peered":"2024-09-21T07:01:02.778310+0000","last_unstale":"2024-09-21T07:01:04.843625+0000","last_undegraded":"2024-09-21T07:01:04.843625+0000","last_fullsized":"2024-09-21T07:01:04.843625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:39.995378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844286+0000","last_change":"2024-09-21T07:01:03.801557+0000","last_active":"2024-09-21T07:01:04.844286+0000","last_peered":"2024-09-21T07:01:04.844286+0000","last_clean":"2024-09-21T07:01:04.844286+0000","last_became_active":"2024-09-21T07:01:03.801233+0000","last_became_peered":"2024-09-21T07:01:03.801233+0000","last_unstale":"2024-09-21T07:01:04.844286+0000","last_undegraded":"2024-09-21T07:01:04.844286+0000","last_fullsized":"2024-09-21T07:01:04.844286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:23:01.557172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.763127+0000","last_change":"2024-09-21T07:01:01.763127+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.763127+0000","last_undegraded":"2024-09-21T07:01:01.763127+0000","last_fullsized":"2024-09-21T07:01:01.763127+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844178+0000","last_change":"2024-09-21T07:01:03.799022+0000","last_active":"2024-09-21T07:01:04.844178+0000","last_peered":"2024-09-21T07:01:04.844178+0000","last_clean":"2024-09-21T07:01:04.844178+0000","last_became_active":"2024-09-21T07:01:03.798589+0000","last_became_peered":"2024-09-21T07:01:03.798589+0000","last_unstale":"2024-09-21T07:01:04.844178+0000","last_undegraded":"2024-09-21T07:01:04.844178+0000","last_fullsized":"2024-09-21T07:01:04.844178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:21.629179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.845030+0000","last_change":"2024-09-21T07:01:02.785856+0000","last_active":"2024-09-21T07:01:04.845030+0000","last_peered":"2024-09-21T07:01:04.845030+0000","last_clean":"2024-09-21T07:01:04.845030+0000","last_became_active":"2024-09-21T07:01:02.785426+0000","last_became_peered":"2024-09-21T07:01:02.785426+0000","last_unstale":"2024-09-21T07:01:04.845030+0000","last_undegraded":"2024-09-21T07:01:04.845030+0000","last_fullsized":"2024-09-21T07:01:04.845030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:21.317089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.762932+0000","last_change":"2024-09-21T07:01:01.762932+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.762932+0000","last_undegraded":"2024-09-21T07:01:01.762932+0000","last_fullsized":"2024-09-21T07:01:01.762932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768173+0000","last_change":"2024-09-21T07:01:03.796538+0000","last_active":"2024-09-21T07:01:04.768173+0000","last_peered":"2024-09-21T07:01:04.768173+0000","last_clean":"2024-09-21T07:01:04.768173+0000","last_became_active":"2024-09-21T07:01:03.796196+0000","last_became_peered":"2024-09-21T07:01:03.796196+0000","last_unstale":"2024-09-21T07:01:04.768173+0000","last_undegraded":"2024-09-21T07:01:04.768173+0000","last_fullsized":"2024-09-21T07:01:04.768173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:33.760115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843918+0000","last_change":"2024-09-21T07:01:02.791472+0000","last_active":"2024-09-21T07:01:04.843918+0000","last_peered":"2024-09-21T07:01:04.843918+0000","last_clean":"2024-09-21T07:01:04.843918+0000","last_became_active":"2024-09-21T07:01:02.791087+0000","last_became_peered":"2024-09-21T07:01:02.791087+0000","last_unstale":"2024-09-21T07:01:04.843918+0000","last_undegraded":"2024-09-21T07:01:04.843918+0000","last_fullsized":"2024-09-21T07:01:04.843918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:37.195545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843171+0000","last_change":"2024-09-21T07:01:03.800189+0000","last_active":"2024-09-21T07:01:04.843171+0000","last_peered":"2024-09-21T07:01:04.843171+0000","last_clean":"2024-09-21T07:01:04.843171+0000","last_became_active":"2024-09-21T07:01:03.799901+0000","last_became_peered":"2024-09-21T07:01:03.799901+0000","last_unstale":"2024-09-21T07:01:04.843171+0000","last_undegraded":"2024-09-21T07:01:04.843171+0000","last_fullsized":"2024-09-21T07:01:04.843171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:58.610632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843353+0000","last_change":"2024-09-21T07:01:02.786240+0000","last_active":"2024-09-21T07:01:04.843353+0000","last_peered":"2024-09-21T07:01:04.843353+0000","last_clean":"2024-09-21T07:01:04.843353+0000","last_became_active":"2024-09-21T07:01:02.785829+0000","last_became_peered":"2024-09-21T07:01:02.785829+0000","last_unstale":"2024-09-21T07:01:04.843353+0000","last_undegraded":"2024-09-21T07:01:04.843353+0000","last_fullsized":"2024-09-21T07:01:04.843353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:52.905472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768169+0000","last_change":"2024-09-21T07:01:03.790770+0000","last_active":"2024-09-21T07:01:04.768169+0000","last_peered":"2024-09-21T07:01:04.768169+0000","last_clean":"2024-09-21T07:01:04.768169+0000","last_became_active":"2024-09-21T07:01:03.790466+0000","last_became_peered":"2024-09-21T07:01:03.790466+0000","last_unstale":"2024-09-21T07:01:04.768169+0000","last_undegraded":"2024-09-21T07:01:04.768169+0000","last_fullsized":"2024-09-21T07:01:04.768169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:39.192000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843624+0000","last_change":"2024-09-21T07:01:02.777473+0000","last_active":"2024-09-21T07:01:04.843624+0000","last_peered":"2024-09-21T07:01:04.843624+0000","last_clean":"2024-09-21T07:01:04.843624+0000","last_became_active":"2024-09-21T07:01:02.777116+0000","last_became_peered":"2024-09-21T07:01:02.777116+0000","last_unstale":"2024-09-21T07:01:04.843624+0000","last_undegraded":"2024-09-21T07:01:04.843624+0000","last_fullsized":"2024-09-21T07:01:04.843624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:59:40.790513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843506+0000","last_change":"2024-09-21T07:01:02.783052+0000","last_active":"2024-09-21T07:01:04.843506+0000","last_peered":"2024-09-21T07:01:04.843506+0000","last_clean":"2024-09-21T07:01:04.843506+0000","last_became_active":"2024-09-21T07:01:02.782729+0000","last_became_peered":"2024-09-21T07:01:02.782729+0000","last_unstale":"2024-09-21T07:01:04.843506+0000","last_undegraded":"2024-09-21T07:01:04.843506+0000","last_fullsized":"2024-09-21T07:01:04.843506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.976446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844084+0000","last_change":"2024-09-21T07:01:03.772763+0000","last_active":"2024-09-21T07:01:04.844084+0000","last_peered":"2024-09-21T07:01:04.844084+0000","last_clean":"2024-09-21T07:01:04.844084+0000","last_became_active":"2024-09-21T07:01:03.772413+0000","last_became_peered":"2024-09-21T07:01:03.772413+0000","last_unstale":"2024-09-21T07:01:04.844084+0000","last_undegraded":"2024-09-21T07:01:04.844084+0000","last_fullsized":"2024-09-21T07:01:04.844084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:04.294355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844234+0000","last_change":"2024-09-21T07:01:02.780860+0000","last_active":"2024-09-21T07:01:04.844234+0000","last_peered":"2024-09-21T07:01:04.844234+0000","last_clean":"2024-09-21T07:01:04.844234+0000","last_became_active":"2024-09-21T07:01:02.780296+0000","last_became_peered":"2024-09-21T07:01:02.780296+0000","last_unstale":"2024-09-21T07:01:04.844234+0000","last_undegraded":"2024-09-21T07:01:04.844234+0000","last_fullsized":"2024-09-21T07:01:04.844234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:36.181080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844702+0000","last_change":"2024-09-21T07:01:02.781901+0000","last_active":"2024-09-21T07:01:04.844702+0000","last_peered":"2024-09-21T07:01:04.844702+0000","last_clean":"2024-09-21T07:01:04.844702+0000","last_became_active":"2024-09-21T07:01:02.781563+0000","last_became_peered":"2024-09-21T07:01:02.781563+0000","last_unstale":"2024-09-21T07:01:04.844702+0000","last_undegraded":"2024-09-21T07:01:04.844702+0000","last_fullsized":"2024-09-21T07:01:04.844702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:20.713409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843954+0000","last_change":"2024-09-21T07:01:02.782653+0000","last_active":"2024-09-21T07:01:04.843954+0000","last_peered":"2024-09-21T07:01:04.843954+0000","last_clean":"2024-09-21T07:01:04.843954+0000","last_became_active":"2024-09-21T07:01:02.782261+0000","last_became_peered":"2024-09-21T07:01:02.782261+0000","last_unstale":"2024-09-21T07:01:04.843954+0000","last_undegraded":"2024-09-21T07:01:04.843954+0000","last_fullsized":"2024-09-21T07:01:04.843954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:15.736038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843335+0000","last_change":"2024-09-21T07:01:03.796498+0000","last_active":"2024-09-21T07:01:04.843335+0000","last_peered":"2024-09-21T07:01:04.843335+0000","last_clean":"2024-09-21T07:01:04.843335+0000","last_became_active":"2024-09-21T07:01:03.796169+0000","last_became_peered":"2024-09-21T07:01:03.796169+0000","last_unstale":"2024-09-21T07:01:04.843335+0000","last_undegraded":"2024-09-21T07:01:04.843335+0000","last_fullsized":"2024-09-21T07:01:04.843335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:50.551965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844229+0000","last_change":"2024-09-21T07:01:02.775824+0000","last_active":"2024-09-21T07:01:04.844229+0000","last_peered":"2024-09-21T07:01:04.844229+0000","last_clean":"2024-09-21T07:01:04.844229+0000","last_became_active":"2024-09-21T07:01:02.775228+0000","last_became_peered":"2024-09-21T07:01:02.775228+0000","last_unstale":"2024-09-21T07:01:04.844229+0000","last_undegraded":"2024-09-21T07:01:04.844229+0000","last_fullsized":"2024-09-21T07:01:04.844229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:37.195545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843771+0000","last_change":"2024-09-21T07:01:03.780446+0000","last_active":"2024-09-21T07:01:04.843771+0000","last_peered":"2024-09-21T07:01:04.843771+0000","last_clean":"2024-09-21T07:01:04.843771+0000","last_became_active":"2024-09-21T07:01:03.780180+0000","last_became_peered":"2024-09-21T07:01:03.780180+0000","last_unstale":"2024-09-21T07:01:04.843771+0000","last_undegraded":"2024-09-21T07:01:04.843771+0000","last_fullsized":"2024-09-21T07:01:04.843771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:57.734540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844036+0000","last_change":"2024-09-21T07:01:02.783777+0000","last_active":"2024-09-21T07:01:04.844036+0000","last_peered":"2024-09-21T07:01:04.844036+0000","last_clean":"2024-09-21T07:01:04.844036+0000","last_became_active":"2024-09-21T07:01:02.783438+0000","last_became_peered":"2024-09-21T07:01:02.783438+0000","last_unstale":"2024-09-21T07:01:04.844036+0000","last_undegraded":"2024-09-21T07:01:04.844036+0000","last_fullsized":"2024-09-21T07:01:04.844036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:44.480439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.762490+0000","last_change":"2024-09-21T07:01:01.762490+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.762490+0000","last_undegraded":"2024-09-21T07:01:01.762490+0000","last_fullsized":"2024-09-21T07:01:01.762490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843383+0000","last_change":"2024-09-21T07:01:03.798215+0000","last_active":"2024-09-21T07:01:04.843383+0000","last_peered":"2024-09-21T07:01:04.843383+0000","last_clean":"2024-09-21T07:01:04.843383+0000","last_became_active":"2024-09-21T07:01:03.796516+0000","last_became_peered":"2024-09-21T07:01:03.796516+0000","last_unstale":"2024-09-21T07:01:04.843383+0000","last_undegraded":"2024-09-21T07:01:04.843383+0000","last_fullsized":"2024-09-21T07:01:04.843383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:28.466335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.763414+0000","last_change":"2024-09-21T07:01:01.763414+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.763414+0000","last_undegraded":"2024-09-21T07:01:01.763414+0000","last_fullsized":"2024-09-21T07:01:01.763414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843741+0000","last_change":"2024-09-21T07:01:03.791099+0000","last_active":"2024-09-21T07:01:04.843741+0000","last_peered":"2024-09-21T07:01:04.843741+0000","last_clean":"2024-09-21T07:01:04.843741+0000","last_became_active":"2024-09-21T07:01:03.790772+0000","last_became_peered":"2024-09-21T07:01:03.790772+0000","last_unstale":"2024-09-21T07:01:04.843741+0000","last_undegraded":"2024-09-21T07:01:04.843741+0000","last_fullsized":"2024-09-21T07:01:04.843741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:33.139496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843700+0000","last_change":"2024-09-21T07:01:02.782460+0000","last_active":"2024-09-21T07:01:04.843700+0000","last_peered":"2024-09-21T07:01:04.843700+0000","last_clean":"2024-09-21T07:01:04.843700+0000","last_became_active":"2024-09-21T07:01:02.782160+0000","last_became_peered":"2024-09-21T07:01:02.782160+0000","last_unstale":"2024-09-21T07:01:04.843700+0000","last_undegraded":"2024-09-21T07:01:04.843700+0000","last_fullsized":"2024-09-21T07:01:04.843700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:24.532930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844055+0000","last_change":"2024-09-21T07:01:03.789639+0000","last_active":"2024-09-21T07:01:04.844055+0000","last_peered":"2024-09-21T07:01:04.844055+0000","last_clean":"2024-09-21T07:01:04.844055+0000","last_became_active":"2024-09-21T07:01:03.789329+0000","last_became_peered":"2024-09-21T07:01:03.789329+0000","last_unstale":"2024-09-21T07:01:04.844055+0000","last_undegraded":"2024-09-21T07:01:04.844055+0000","last_fullsized":"2024-09-21T07:01:04.844055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:28.686912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843894+0000","last_change":"2024-09-21T07:01:02.780877+0000","last_active":"2024-09-21T07:01:04.843894+0000","last_peered":"2024-09-21T07:01:04.843894+0000","last_clean":"2024-09-21T07:01:04.843894+0000","last_became_active":"2024-09-21T07:01:02.780530+0000","last_became_peered":"2024-09-21T07:01:02.780530+0000","last_unstale":"2024-09-21T07:01:04.843894+0000","last_undegraded":"2024-09-21T07:01:04.843894+0000","last_fullsized":"2024-09-21T07:01:04.843894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:28.933785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768917+0000","last_change":"2024-09-21T07:01:03.790197+0000","last_active":"2024-09-21T07:01:04.768917+0000","last_peered":"2024-09-21T07:01:04.768917+0000","last_clean":"2024-09-21T07:01:04.768917+0000","last_became_active":"2024-09-21T07:01:03.789769+0000","last_became_peered":"2024-09-21T07:01:03.789769+0000","last_unstale":"2024-09-21T07:01:04.768917+0000","last_undegraded":"2024-09-21T07:01:04.768917+0000","last_fullsized":"2024-09-21T07:01:04.768917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:32.176127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844415+0000","last_change":"2024-09-21T07:01:02.792339+0000","last_active":"2024-09-21T07:01:04.844415+0000","last_peered":"2024-09-21T07:01:04.844415+0000","last_clean":"2024-09-21T07:01:04.844415+0000","last_became_active":"2024-09-21T07:01:02.791971+0000","last_became_peered":"2024-09-21T07:01:02.791971+0000","last_unstale":"2024-09-21T07:01:04.844415+0000","last_undegraded":"2024-09-21T07:01:04.844415+0000","last_fullsized":"2024-09-21T07:01:04.844415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:43.713520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844168+0000","last_change":"2024-09-21T07:01:03.782318+0000","last_active":"2024-09-21T07:01:04.844168+0000","last_peered":"2024-09-21T07:01:04.844168+0000","last_clean":"2024-09-21T07:01:04.844168+0000","last_became_active":"2024-09-21T07:01:03.781942+0000","last_became_peered":"2024-09-21T07:01:03.781942+0000","last_unstale":"2024-09-21T07:01:04.844168+0000","last_undegraded":"2024-09-21T07:01:04.844168+0000","last_fullsized":"2024-09-21T07:01:04.844168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:34.894160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843829+0000","last_change":"2024-09-21T07:01:02.779001+0000","last_active":"2024-09-21T07:01:04.843829+0000","last_peered":"2024-09-21T07:01:04.843829+0000","last_clean":"2024-09-21T07:01:04.843829+0000","last_became_active":"2024-09-21T07:01:02.778522+0000","last_became_peered":"2024-09-21T07:01:02.778522+0000","last_unstale":"2024-09-21T07:01:04.843829+0000","last_undegraded":"2024-09-21T07:01:04.843829+0000","last_fullsized":"2024-09-21T07:01:04.843829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:03.188520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844992+0000","last_change":"2024-09-21T07:01:03.790572+0000","last_active":"2024-09-21T07:01:04.844992+0000","last_peered":"2024-09-21T07:01:04.844992+0000","last_clean":"2024-09-21T07:01:04.844992+0000","last_became_active":"2024-09-21T07:01:03.790070+0000","last_became_peered":"2024-09-21T07:01:03.790070+0000","last_unstale":"2024-09-21T07:01:04.844992+0000","last_undegraded":"2024-09-21T07:01:04.844992+0000","last_fullsized":"2024-09-21T07:01:04.844992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:40.124786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767672+0000","last_change":"2024-09-21T07:01:02.778072+0000","last_active":"2024-09-21T07:01:04.767672+0000","last_peered":"2024-09-21T07:01:04.767672+0000","last_clean":"2024-09-21T07:01:04.767672+0000","last_became_active":"2024-09-21T07:01:02.777714+0000","last_became_peered":"2024-09-21T07:01:02.777714+0000","last_unstale":"2024-09-21T07:01:04.767672+0000","last_undegraded":"2024-09-21T07:01:04.767672+0000","last_fullsized":"2024-09-21T07:01:04.767672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:05.574202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844019+0000","last_change":"2024-09-21T07:01:03.792264+0000","last_active":"2024-09-21T07:01:04.844019+0000","last_peered":"2024-09-21T07:01:04.844019+0000","last_clean":"2024-09-21T07:01:04.844019+0000","last_became_active":"2024-09-21T07:01:03.791787+0000","last_became_peered":"2024-09-21T07:01:03.791787+0000","last_unstale":"2024-09-21T07:01:04.844019+0000","last_undegraded":"2024-09-21T07:01:04.844019+0000","last_fullsized":"2024-09-21T07:01:04.844019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843915+0000","last_change":"2024-09-21T07:01:02.778713+0000","last_active":"2024-09-21T07:01:04.843915+0000","last_peered":"2024-09-21T07:01:04.843915+0000","last_clean":"2024-09-21T07:01:04.843915+0000","last_became_active":"2024-09-21T07:01:02.778375+0000","last_became_peered":"2024-09-21T07:01:02.778375+0000","last_unstale":"2024-09-21T07:01:04.843915+0000","last_undegraded":"2024-09-21T07:01:04.843915+0000","last_fullsized":"2024-09-21T07:01:04.843915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:41.462449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843779+0000","last_change":"2024-09-21T07:01:03.777959+0000","last_active":"2024-09-21T07:01:04.843779+0000","last_peered":"2024-09-21T07:01:04.843779+0000","last_clean":"2024-09-21T07:01:04.843779+0000","last_became_active":"2024-09-21T07:01:03.777648+0000","last_became_peered":"2024-09-21T07:01:03.777648+0000","last_unstale":"2024-09-21T07:01:04.843779+0000","last_undegraded":"2024-09-21T07:01:04.843779+0000","last_fullsized":"2024-09-21T07:01:04.843779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:11.993232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843470+0000","last_change":"2024-09-21T07:01:02.792375+0000","last_active":"2024-09-21T07:01:04.843470+0000","last_peered":"2024-09-21T07:01:04.843470+0000","last_clean":"2024-09-21T07:01:04.843470+0000","last_became_active":"2024-09-21T07:01:02.792035+0000","last_became_peered":"2024-09-21T07:01:02.792035+0000","last_unstale":"2024-09-21T07:01:04.843470+0000","last_undegraded":"2024-09-21T07:01:04.843470+0000","last_fullsized":"2024-09-21T07:01:04.843470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:38.186488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843785+0000","last_change":"2024-09-21T07:01:03.788441+0000","last_active":"2024-09-21T07:01:04.843785+0000","last_peered":"2024-09-21T07:01:04.843785+0000","last_clean":"2024-09-21T07:01:04.843785+0000","last_became_active":"2024-09-21T07:01:03.788130+0000","last_became_peered":"2024-09-21T07:01:03.788130+0000","last_unstale":"2024-09-21T07:01:04.843785+0000","last_undegraded":"2024-09-21T07:01:04.843785+0000","last_fullsized":"2024-09-21T07:01:04.843785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:13.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768417+0000","last_change":"2024-09-21T07:01:02.776793+0000","last_active":"2024-09-21T07:01:04.768417+0000","last_peered":"2024-09-21T07:01:04.768417+0000","last_clean":"2024-09-21T07:01:04.768417+0000","last_became_active":"2024-09-21T07:01:02.775460+0000","last_became_peered":"2024-09-21T07:01:02.775460+0000","last_unstale":"2024-09-21T07:01:04.768417+0000","last_undegraded":"2024-09-21T07:01:04.768417+0000","last_fullsized":"2024-09-21T07:01:04.768417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:05.467271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768307+0000","last_change":"2024-09-21T07:01:03.791274+0000","last_active":"2024-09-21T07:01:04.768307+0000","last_peered":"2024-09-21T07:01:04.768307+0000","last_clean":"2024-09-21T07:01:04.768307+0000","last_became_active":"2024-09-21T07:01:03.790995+0000","last_became_peered":"2024-09-21T07:01:03.790995+0000","last_unstale":"2024-09-21T07:01:04.768307+0000","last_undegraded":"2024-09-21T07:01:04.768307+0000","last_fullsized":"2024-09-21T07:01:04.768307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:52.515976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843395+0000","last_change":"2024-09-21T07:01:02.781006+0000","last_active":"2024-09-21T07:01:04.843395+0000","last_peered":"2024-09-21T07:01:04.843395+0000","last_clean":"2024-09-21T07:01:04.843395+0000","last_became_active":"2024-09-21T07:01:02.780061+0000","last_became_peered":"2024-09-21T07:01:02.780061+0000","last_unstale":"2024-09-21T07:01:04.843395+0000","last_undegraded":"2024-09-21T07:01:04.843395+0000","last_fullsized":"2024-09-21T07:01:04.843395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:26.121246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844799+0000","last_change":"2024-09-21T07:01:03.790603+0000","last_active":"2024-09-21T07:01:04.844799+0000","last_peered":"2024-09-21T07:01:04.844799+0000","last_clean":"2024-09-21T07:01:04.844799+0000","last_became_active":"2024-09-21T07:01:03.790244+0000","last_became_peered":"2024-09-21T07:01:03.790244+0000","last_unstale":"2024-09-21T07:01:04.844799+0000","last_undegraded":"2024-09-21T07:01:04.844799+0000","last_fullsized":"2024-09-21T07:01:04.844799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:07.386079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843927+0000","last_change":"2024-09-21T07:01:02.790264+0000","last_active":"2024-09-21T07:01:04.843927+0000","last_peered":"2024-09-21T07:01:04.843927+0000","last_clean":"2024-09-21T07:01:04.843927+0000","last_became_active":"2024-09-21T07:01:02.789872+0000","last_became_peered":"2024-09-21T07:01:02.789872+0000","last_unstale":"2024-09-21T07:01:04.843927+0000","last_undegraded":"2024-09-21T07:01:04.843927+0000","last_fullsized":"2024-09-21T07:01:04.843927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.976446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843758+0000","last_change":"2024-09-21T07:01:03.781029+0000","last_active":"2024-09-21T07:01:04.843758+0000","last_peered":"2024-09-21T07:01:04.843758+0000","last_clean":"2024-09-21T07:01:04.843758+0000","last_became_active":"2024-09-21T07:01:03.780695+0000","last_became_peered":"2024-09-21T07:01:03.780695+0000","last_unstale":"2024-09-21T07:01:04.843758+0000","last_undegraded":"2024-09-21T07:01:04.843758+0000","last_fullsized":"2024-09-21T07:01:04.843758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:24.208627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844717+0000","last_change":"2024-09-21T07:01:02.781328+0000","last_active":"2024-09-21T07:01:04.844717+0000","last_peered":"2024-09-21T07:01:04.844717+0000","last_clean":"2024-09-21T07:01:04.844717+0000","last_became_active":"2024-09-21T07:01:02.780299+0000","last_became_peered":"2024-09-21T07:01:02.780299+0000","last_unstale":"2024-09-21T07:01:04.844717+0000","last_undegraded":"2024-09-21T07:01:04.844717+0000","last_fullsized":"2024-09-21T07:01:04.844717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:56.729028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844953+0000","last_change":"2024-09-21T07:01:03.795504+0000","last_active":"2024-09-21T07:01:04.844953+0000","last_peered":"2024-09-21T07:01:04.844953+0000","last_clean":"2024-09-21T07:01:04.844953+0000","last_became_active":"2024-09-21T07:01:03.795137+0000","last_became_peered":"2024-09-21T07:01:03.795137+0000","last_unstale":"2024-09-21T07:01:04.844953+0000","last_undegraded":"2024-09-21T07:01:04.844953+0000","last_fullsized":"2024-09-21T07:01:04.844953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:35.892752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844355+0000","last_change":"2024-09-21T07:01:02.778586+0000","last_active":"2024-09-21T07:01:04.844355+0000","last_peered":"2024-09-21T07:01:04.844355+0000","last_clean":"2024-09-21T07:01:04.844355+0000","last_became_active":"2024-09-21T07:01:02.778221+0000","last_became_peered":"2024-09-21T07:01:02.778221+0000","last_unstale":"2024-09-21T07:01:04.844355+0000","last_undegraded":"2024-09-21T07:01:04.844355+0000","last_fullsized":"2024-09-21T07:01:04.844355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:31.170615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767423+0000","last_change":"2024-09-21T07:01:03.779595+0000","last_active":"2024-09-21T07:01:04.767423+0000","last_peered":"2024-09-21T07:01:04.767423+0000","last_clean":"2024-09-21T07:01:04.767423+0000","last_became_active":"2024-09-21T07:01:03.778855+0000","last_became_peered":"2024-09-21T07:01:03.778855+0000","last_unstale":"2024-09-21T07:01:04.767423+0000","last_undegraded":"2024-09-21T07:01:04.767423+0000","last_fullsized":"2024-09-21T07:01:04.767423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:43.811241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844675+0000","last_change":"2024-09-21T07:01:02.790214+0000","last_active":"2024-09-21T07:01:04.844675+0000","last_peered":"2024-09-21T07:01:04.844675+0000","last_clean":"2024-09-21T07:01:04.844675+0000","last_became_active":"2024-09-21T07:01:02.789887+0000","last_became_peered":"2024-09-21T07:01:02.789887+0000","last_unstale":"2024-09-21T07:01:04.844675+0000","last_undegraded":"2024-09-21T07:01:04.844675+0000","last_fullsized":"2024-09-21T07:01:04.844675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:51.510464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844153+0000","last_change":"2024-09-21T07:01:02.777740+0000","last_active":"2024-09-21T07:01:04.844153+0000","last_peered":"2024-09-21T07:01:04.844153+0000","last_clean":"2024-09-21T07:01:04.844153+0000","last_became_active":"2024-09-21T07:01:02.777294+0000","last_became_peered":"2024-09-21T07:01:02.777294+0000","last_unstale":"2024-09-21T07:01:04.844153+0000","last_undegraded":"2024-09-21T07:01:04.844153+0000","last_fullsized":"2024-09-21T07:01:04.844153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:44.480439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843373+0000","last_change":"2024-09-21T07:01:02.792247+0000","last_active":"2024-09-21T07:01:04.843373+0000","last_peered":"2024-09-21T07:01:04.843373+0000","last_clean":"2024-09-21T07:01:04.843373+0000","last_became_active":"2024-09-21T07:01:02.791859+0000","last_became_peered":"2024-09-21T07:01:02.791859+0000","last_unstale":"2024-09-21T07:01:04.843373+0000","last_undegraded":"2024-09-21T07:01:04.843373+0000","last_fullsized":"2024-09-21T07:01:04.843373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:51.510464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843787+0000","last_change":"2024-09-21T07:01:03.782839+0000","last_active":"2024-09-21T07:01:04.843787+0000","last_peered":"2024-09-21T07:01:04.843787+0000","last_clean":"2024-09-21T07:01:04.843787+0000","last_became_active":"2024-09-21T07:01:03.782446+0000","last_became_peered":"2024-09-21T07:01:03.782446+0000","last_unstale":"2024-09-21T07:01:04.843787+0000","last_undegraded":"2024-09-21T07:01:04.843787+0000","last_fullsized":"2024-09-21T07:01:04.843787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:29.430348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.762492+0000","last_change":"2024-09-21T07:01:01.762492+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.762492+0000","last_undegraded":"2024-09-21T07:01:01.762492+0000","last_fullsized":"2024-09-21T07:01:01.762492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767690+0000","last_change":"2024-09-21T07:01:03.788278+0000","last_active":"2024-09-21T07:01:04.767690+0000","last_peered":"2024-09-21T07:01:04.767690+0000","last_clean":"2024-09-21T07:01:04.767690+0000","last_became_active":"2024-09-21T07:01:03.787728+0000","last_became_peered":"2024-09-21T07:01:03.787728+0000","last_unstale":"2024-09-21T07:01:04.767690+0000","last_undegraded":"2024-09-21T07:01:04.767690+0000","last_fullsized":"2024-09-21T07:01:04.767690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:04.194032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843977+0000","last_change":"2024-09-21T07:01:02.779208+0000","last_active":"2024-09-21T07:01:04.843977+0000","last_peered":"2024-09-21T07:01:04.843977+0000","last_clean":"2024-09-21T07:01:04.843977+0000","last_became_active":"2024-09-21T07:01:02.778011+0000","last_became_peered":"2024-09-21T07:01:02.778011+0000","last_unstale":"2024-09-21T07:01:04.843977+0000","last_undegraded":"2024-09-21T07:01:04.843977+0000","last_fullsized":"2024-09-21T07:01:04.843977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:04.375217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767896+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:01:04.767896+0000","last_peered":"2024-09-21T07:01:04.767896+0000","last_clean":"2024-09-21T07:01:04.767896+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:01:04.767896+0000","last_undegraded":"2024-09-21T07:01:04.767896+0000","last_fullsized":"2024-09-21T07:01:04.767896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":133486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,11],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":364544,"data_stored":135076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":730714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":134240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":133498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":730202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":133554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:01:07.848 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:01:08.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.000+0000 7f1980484640 1 -- 172.21.15.63:0/3544606527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1960004d40 msgr2=0x7f1960005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.000+0000 7f1980484640 1 --2- 172.21.15.63:0/3544606527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1960004d40 0x7f1960005150 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1968002230 tx=0x7f1960005830 comp rx=0 tx=0).stop 2024-09-21T07:01:08.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.000+0000 7f197ea21640 1 -- 172.21.15.63:0/3544606527 reap_dead start 2024-09-21T07:01:08.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.000+0000 7f1980484640 1 -- 172.21.15.63:0/3544606527 shutdown_connections 2024-09-21T07:01:08.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.000+0000 7f1980484640 1 -- 172.21.15.63:0/3544606527 >> 172.21.15.63:0/3544606527 conn(0x7f19780b2f70 msgr2=0x7f19780b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.000+0000 7f1980484640 1 -- 172.21.15.63:0/3544606527 shutdown_connections 2024-09-21T07:01:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.000+0000 7f1980484640 1 -- 172.21.15.63:0/3544606527 wait complete. 2024-09-21T07:01:08.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.002+0000 7f1980484640 1 Processor -- start 2024-09-21T07:01:08.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.002+0000 7f1980484640 1 -- start start 2024-09-21T07:01:08.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.003+0000 7f1980484640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1960004d40 0x7f1978152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:08.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.003+0000 7f1980484640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19781e8000 0x7f1978070750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:08.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.003+0000 7f1980484640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1978070c90 0x7f19780aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:08.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.003+0000 7f1980484640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f19780d0290 con 0x7f1960004d40 2024-09-21T07:01:08.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.003+0000 7f1980484640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f19780b69c0 con 0x7f19781e8000 2024-09-21T07:01:08.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.003+0000 7f1980484640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f19780d0410 con 0x7f1978070c90 2024-09-21T07:01:08.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.003+0000 7f197e220640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1960004d40 0x7f1978152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:08.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.003+0000 7f197e220640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1960004d40 0x7f1978152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39074/0 (socket says 172.21.15.63:39074) 2024-09-21T07:01:08.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.003+0000 7f197e220640 1 -- 172.21.15.63:0/3337990419 learned_addr learned my addr 172.21.15.63:0/3337990419 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:08.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.003+0000 7f197da1f640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19781e8000 0x7f1978070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.003+0000 7f197ea21640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1978070c90 0x7f19780aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.004+0000 7f197e220640 1 -- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1978070c90 msgr2=0x7f19780aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.004+0000 7f197e220640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1978070c90 0x7f19780aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.004+0000 7f197e220640 1 -- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19781e8000 msgr2=0x7f1978070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.004+0000 7f197e220640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19781e8000 0x7f1978070750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.004+0000 7f197e220640 1 -- 172.21.15.63:0/3337990419 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19780710a0 con 0x7f1960004d40 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.004+0000 7f197ea21640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1978070c90 0x7f19780aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.004+0000 7f197da1f640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19781e8000 0x7f1978070750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.004+0000 7f197e220640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1960004d40 0x7f1978152760 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1970011bf0 tx=0x7f197000e780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.004+0000 7f1976ffd640 1 -- 172.21.15.63:0/3337990419 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1970004260 con 0x7f1960004d40 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.004+0000 7f1976ffd640 1 -- 172.21.15.63:0/3337990419 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1970004400 con 0x7f1960004d40 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.004+0000 7f1980484640 1 -- 172.21.15.63:0/3337990419 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1978152ca0 con 0x7f1960004d40 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.004+0000 7f1976ffd640 1 -- 172.21.15.63:0/3337990419 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1970003850 con 0x7f1960004d40 2024-09-21T07:01:08.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.004+0000 7f1980484640 1 -- 172.21.15.63:0/3337990419 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f197809f160 con 0x7f1960004d40 2024-09-21T07:01:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.005+0000 7f1980484640 1 -- 172.21.15.63:0/3337990419 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19780cfa50 con 0x7f1960004d40 2024-09-21T07:01:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.006+0000 7f1976ffd640 1 -- 172.21.15.63:0/3337990419 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f19700039f0 con 0x7f1960004d40 2024-09-21T07:01:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.006+0000 7f1976ffd640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1964078bf0 0x7f196407b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:08.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.007+0000 7f1976ffd640 1 -- 172.21.15.63:0/3337990419 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f197009dcf0 con 0x7f1960004d40 2024-09-21T07:01:08.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.007+0000 7f197da1f640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1964078bf0 0x7f196407b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:08.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.007+0000 7f197da1f640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1964078bf0 0x7f196407b100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f19780b1e20 tx=0x7f196c005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:08.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.011+0000 7f1976ffd640 1 -- 172.21.15.63:0/3337990419 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f19700a2070 con 0x7f1960004d40 2024-09-21T07:01:08.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.195+0000 7f1980484640 1 -- 172.21.15.63:0/3337990419 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19780d0970 con 0x7f1964078bf0 2024-09-21T07:01:08.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.200+0000 7f1976ffd640 1 -- 172.21.15.63:0/3337990419 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249933 (secure 0 0 0) 0x7f19780d0970 con 0x7f1964078bf0 2024-09-21T07:01:08.204 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:08.205 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:01:08.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.203+0000 7f1980484640 1 -- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1964078bf0 msgr2=0x7f196407b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.203+0000 7f1980484640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1964078bf0 0x7f196407b100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f19780b1e20 tx=0x7f196c005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:08.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.203+0000 7f1980484640 1 -- 172.21.15.63:0/3337990419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1960004d40 msgr2=0x7f1978152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.203+0000 7f1980484640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1960004d40 0x7f1978152760 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1970011bf0 tx=0x7f197000e780 comp rx=0 tx=0).stop 2024-09-21T07:01:08.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.203+0000 7f1980484640 1 -- 172.21.15.63:0/3337990419 shutdown_connections 2024-09-21T07:01:08.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.203+0000 7f1980484640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1964078bf0 0x7f196407b100 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.203+0000 7f1980484640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1978070c90 0x7f19780aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.203+0000 7f1980484640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19781e8000 0x7f1978070750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.203+0000 7f1980484640 1 --2- 172.21.15.63:0/3337990419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1960004d40 0x7f1978152760 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.203+0000 7f1980484640 1 -- 172.21.15.63:0/3337990419 >> 172.21.15.63:0/3337990419 conn(0x7f19780b2f70 msgr2=0x7f19780b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:08.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.203+0000 7f1980484640 1 -- 172.21.15.63:0/3337990419 shutdown_connections 2024-09-21T07:01:08.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.203+0000 7f1980484640 1 -- 172.21.15.63:0/3337990419 wait complete. 2024-09-21T07:01:08.216 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-21T07:01:06.608025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":142,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220224,"kb_used_data":3960,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754496,"statfs":{"total":773094113280,"available":772868603904,"internally_reserved":0,"allocated":4055040,"data_stored":2251184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,11],"upper_bound":32},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.847185"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844066+0000","last_change":"2024-09-21T07:01:03.794142+0000","last_active":"2024-09-21T07:01:04.844066+0000","last_peered":"2024-09-21T07:01:04.844066+0000","last_clean":"2024-09-21T07:01:04.844066+0000","last_became_active":"2024-09-21T07:01:03.790316+0000","last_became_peered":"2024-09-21T07:01:03.790316+0000","last_unstale":"2024-09-21T07:01:04.844066+0000","last_undegraded":"2024-09-21T07:01:04.844066+0000","last_fullsized":"2024-09-21T07:01:04.844066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:19.787933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844566+0000","last_change":"2024-09-21T07:01:03.791660+0000","last_active":"2024-09-21T07:01:04.844566+0000","last_peered":"2024-09-21T07:01:04.844566+0000","last_clean":"2024-09-21T07:01:04.844566+0000","last_became_active":"2024-09-21T07:01:03.790741+0000","last_became_peered":"2024-09-21T07:01:03.790741+0000","last_unstale":"2024-09-21T07:01:04.844566+0000","last_undegraded":"2024-09-21T07:01:04.844566+0000","last_fullsized":"2024-09-21T07:01:04.844566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.262768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768560+0000","last_change":"2024-09-21T07:01:03.792492+0000","last_active":"2024-09-21T07:01:04.768560+0000","last_peered":"2024-09-21T07:01:04.768560+0000","last_clean":"2024-09-21T07:01:04.768560+0000","last_became_active":"2024-09-21T07:01:03.792164+0000","last_became_peered":"2024-09-21T07:01:03.792164+0000","last_unstale":"2024-09-21T07:01:04.768560+0000","last_undegraded":"2024-09-21T07:01:04.768560+0000","last_fullsized":"2024-09-21T07:01:04.768560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:38.201057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843541+0000","last_change":"2024-09-21T07:01:03.775605+0000","last_active":"2024-09-21T07:01:04.843541+0000","last_peered":"2024-09-21T07:01:04.843541+0000","last_clean":"2024-09-21T07:01:04.843541+0000","last_became_active":"2024-09-21T07:01:03.775096+0000","last_became_peered":"2024-09-21T07:01:03.775096+0000","last_unstale":"2024-09-21T07:01:04.843541+0000","last_undegraded":"2024-09-21T07:01:04.843541+0000","last_fullsized":"2024-09-21T07:01:04.843541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:23.836413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844759+0000","last_change":"2024-09-21T07:01:03.801253+0000","last_active":"2024-09-21T07:01:04.844759+0000","last_peered":"2024-09-21T07:01:04.844759+0000","last_clean":"2024-09-21T07:01:04.844759+0000","last_became_active":"2024-09-21T07:01:03.800920+0000","last_became_peered":"2024-09-21T07:01:03.800920+0000","last_unstale":"2024-09-21T07:01:04.844759+0000","last_undegraded":"2024-09-21T07:01:04.844759+0000","last_fullsized":"2024-09-21T07:01:04.844759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:42.751536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843408+0000","last_change":"2024-09-21T07:01:03.795428+0000","last_active":"2024-09-21T07:01:04.843408+0000","last_peered":"2024-09-21T07:01:04.843408+0000","last_clean":"2024-09-21T07:01:04.843408+0000","last_became_active":"2024-09-21T07:01:03.795098+0000","last_became_peered":"2024-09-21T07:01:03.795098+0000","last_unstale":"2024-09-21T07:01:04.843408+0000","last_undegraded":"2024-09-21T07:01:04.843408+0000","last_fullsized":"2024-09-21T07:01:04.843408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843685+0000","last_change":"2024-09-21T07:01:03.795965+0000","last_active":"2024-09-21T07:01:04.843685+0000","last_peered":"2024-09-21T07:01:04.843685+0000","last_clean":"2024-09-21T07:01:04.843685+0000","last_became_active":"2024-09-21T07:01:03.795485+0000","last_became_peered":"2024-09-21T07:01:03.795485+0000","last_unstale":"2024-09-21T07:01:04.843685+0000","last_undegraded":"2024-09-21T07:01:04.843685+0000","last_fullsized":"2024-09-21T07:01:04.843685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:45.129827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768692+0000","last_change":"2024-09-21T07:01:03.797379+0000","last_active":"2024-09-21T07:01:04.768692+0000","last_peered":"2024-09-21T07:01:04.768692+0000","last_clean":"2024-09-21T07:01:04.768692+0000","last_became_active":"2024-09-21T07:01:03.797038+0000","last_became_peered":"2024-09-21T07:01:03.797038+0000","last_unstale":"2024-09-21T07:01:04.768692+0000","last_undegraded":"2024-09-21T07:01:04.768692+0000","last_fullsized":"2024-09-21T07:01:04.768692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.981958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843680+0000","last_change":"2024-09-21T07:01:03.797615+0000","last_active":"2024-09-21T07:01:04.843680+0000","last_peered":"2024-09-21T07:01:04.843680+0000","last_clean":"2024-09-21T07:01:04.843680+0000","last_became_active":"2024-09-21T07:01:03.796962+0000","last_became_peered":"2024-09-21T07:01:03.796962+0000","last_unstale":"2024-09-21T07:01:04.843680+0000","last_undegraded":"2024-09-21T07:01:04.843680+0000","last_fullsized":"2024-09-21T07:01:04.843680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:29.202843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768150+0000","last_change":"2024-09-21T07:01:03.788053+0000","last_active":"2024-09-21T07:01:04.768150+0000","last_peered":"2024-09-21T07:01:04.768150+0000","last_clean":"2024-09-21T07:01:04.768150+0000","last_became_active":"2024-09-21T07:01:03.787728+0000","last_became_peered":"2024-09-21T07:01:03.787728+0000","last_unstale":"2024-09-21T07:01:04.768150+0000","last_undegraded":"2024-09-21T07:01:04.768150+0000","last_fullsized":"2024-09-21T07:01:04.768150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:44.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844461+0000","last_change":"2024-09-21T07:01:03.792564+0000","last_active":"2024-09-21T07:01:04.844461+0000","last_peered":"2024-09-21T07:01:04.844461+0000","last_clean":"2024-09-21T07:01:04.844461+0000","last_became_active":"2024-09-21T07:01:03.791629+0000","last_became_peered":"2024-09-21T07:01:03.791629+0000","last_unstale":"2024-09-21T07:01:04.844461+0000","last_undegraded":"2024-09-21T07:01:04.844461+0000","last_fullsized":"2024-09-21T07:01:04.844461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:58.610632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767157+0000","last_change":"2024-09-21T07:01:03.801933+0000","last_active":"2024-09-21T07:01:04.767157+0000","last_peered":"2024-09-21T07:01:04.767157+0000","last_clean":"2024-09-21T07:01:04.767157+0000","last_became_active":"2024-09-21T07:01:03.801563+0000","last_became_peered":"2024-09-21T07:01:03.801563+0000","last_unstale":"2024-09-21T07:01:04.767157+0000","last_undegraded":"2024-09-21T07:01:04.767157+0000","last_fullsized":"2024-09-21T07:01:04.767157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:34.894160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767121+0000","last_change":"2024-09-21T07:01:03.787523+0000","last_active":"2024-09-21T07:01:04.767121+0000","last_peered":"2024-09-21T07:01:04.767121+0000","last_clean":"2024-09-21T07:01:04.767121+0000","last_became_active":"2024-09-21T07:01:03.786731+0000","last_became_peered":"2024-09-21T07:01:03.786731+0000","last_unstale":"2024-09-21T07:01:04.767121+0000","last_undegraded":"2024-09-21T07:01:04.767121+0000","last_fullsized":"2024-09-21T07:01:04.767121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:11.993232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843403+0000","last_change":"2024-09-21T07:01:03.799976+0000","last_active":"2024-09-21T07:01:04.843403+0000","last_peered":"2024-09-21T07:01:04.843403+0000","last_clean":"2024-09-21T07:01:04.843403+0000","last_became_active":"2024-09-21T07:01:03.799425+0000","last_became_peered":"2024-09-21T07:01:03.799425+0000","last_unstale":"2024-09-21T07:01:04.843403+0000","last_undegraded":"2024-09-21T07:01:04.843403+0000","last_fullsized":"2024-09-21T07:01:04.843403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:37.275079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844401+0000","last_change":"2024-09-21T07:01:03.781832+0000","last_active":"2024-09-21T07:01:04.844401+0000","last_peered":"2024-09-21T07:01:04.844401+0000","last_clean":"2024-09-21T07:01:04.844401+0000","last_became_active":"2024-09-21T07:01:03.779709+0000","last_became_peered":"2024-09-21T07:01:03.779709+0000","last_unstale":"2024-09-21T07:01:04.844401+0000","last_undegraded":"2024-09-21T07:01:04.844401+0000","last_fullsized":"2024-09-21T07:01:04.844401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:04.995003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844689+0000","last_change":"2024-09-21T07:01:03.788320+0000","last_active":"2024-09-21T07:01:04.844689+0000","last_peered":"2024-09-21T07:01:04.844689+0000","last_clean":"2024-09-21T07:01:04.844689+0000","last_became_active":"2024-09-21T07:01:03.787978+0000","last_became_peered":"2024-09-21T07:01:03.787978+0000","last_unstale":"2024-09-21T07:01:04.844689+0000","last_undegraded":"2024-09-21T07:01:04.844689+0000","last_fullsized":"2024-09-21T07:01:04.844689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:18.875542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844064+0000","last_change":"2024-09-21T07:01:03.792145+0000","last_active":"2024-09-21T07:01:04.844064+0000","last_peered":"2024-09-21T07:01:04.844064+0000","last_clean":"2024-09-21T07:01:04.844064+0000","last_became_active":"2024-09-21T07:01:03.791766+0000","last_became_peered":"2024-09-21T07:01:03.791766+0000","last_unstale":"2024-09-21T07:01:04.844064+0000","last_undegraded":"2024-09-21T07:01:04.844064+0000","last_fullsized":"2024-09-21T07:01:04.844064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:45.001116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767414+0000","last_change":"2024-09-21T07:01:03.788762+0000","last_active":"2024-09-21T07:01:04.767414+0000","last_peered":"2024-09-21T07:01:04.767414+0000","last_clean":"2024-09-21T07:01:04.767414+0000","last_became_active":"2024-09-21T07:01:03.788372+0000","last_became_peered":"2024-09-21T07:01:03.788372+0000","last_unstale":"2024-09-21T07:01:04.767414+0000","last_undegraded":"2024-09-21T07:01:04.767414+0000","last_fullsized":"2024-09-21T07:01:04.767414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:19.787933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843211+0000","last_change":"2024-09-21T07:01:03.799507+0000","last_active":"2024-09-21T07:01:04.843211+0000","last_peered":"2024-09-21T07:01:04.843211+0000","last_clean":"2024-09-21T07:01:04.843211+0000","last_became_active":"2024-09-21T07:01:03.798713+0000","last_became_peered":"2024-09-21T07:01:03.798713+0000","last_unstale":"2024-09-21T07:01:04.843211+0000","last_undegraded":"2024-09-21T07:01:04.843211+0000","last_fullsized":"2024-09-21T07:01:04.843211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:42.573263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843765+0000","last_change":"2024-09-21T07:01:03.781265+0000","last_active":"2024-09-21T07:01:04.843765+0000","last_peered":"2024-09-21T07:01:04.843765+0000","last_clean":"2024-09-21T07:01:04.843765+0000","last_became_active":"2024-09-21T07:01:03.780969+0000","last_became_peered":"2024-09-21T07:01:03.780969+0000","last_unstale":"2024-09-21T07:01:04.843765+0000","last_undegraded":"2024-09-21T07:01:04.843765+0000","last_fullsized":"2024-09-21T07:01:04.843765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:59.851233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843141+0000","last_change":"2024-09-21T07:01:03.799128+0000","last_active":"2024-09-21T07:01:04.843141+0000","last_peered":"2024-09-21T07:01:04.843141+0000","last_clean":"2024-09-21T07:01:04.843141+0000","last_became_active":"2024-09-21T07:01:03.798706+0000","last_became_peered":"2024-09-21T07:01:03.798706+0000","last_unstale":"2024-09-21T07:01:04.843141+0000","last_undegraded":"2024-09-21T07:01:04.843141+0000","last_fullsized":"2024-09-21T07:01:04.843141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:56.371767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844561+0000","last_change":"2024-09-21T07:01:03.789643+0000","last_active":"2024-09-21T07:01:04.844561+0000","last_peered":"2024-09-21T07:01:04.844561+0000","last_clean":"2024-09-21T07:01:04.844561+0000","last_became_active":"2024-09-21T07:01:03.789249+0000","last_became_peered":"2024-09-21T07:01:03.789249+0000","last_unstale":"2024-09-21T07:01:04.844561+0000","last_undegraded":"2024-09-21T07:01:04.844561+0000","last_fullsized":"2024-09-21T07:01:04.844561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:24.747636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844048+0000","last_change":"2024-09-21T07:01:03.793850+0000","last_active":"2024-09-21T07:01:04.844048+0000","last_peered":"2024-09-21T07:01:04.844048+0000","last_clean":"2024-09-21T07:01:04.844048+0000","last_became_active":"2024-09-21T07:01:03.790220+0000","last_became_peered":"2024-09-21T07:01:03.790220+0000","last_unstale":"2024-09-21T07:01:04.844048+0000","last_undegraded":"2024-09-21T07:01:04.844048+0000","last_fullsized":"2024-09-21T07:01:04.844048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.262768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767762+0000","last_change":"2024-09-21T07:01:03.802120+0000","last_active":"2024-09-21T07:01:04.767762+0000","last_peered":"2024-09-21T07:01:04.767762+0000","last_clean":"2024-09-21T07:01:04.767762+0000","last_became_active":"2024-09-21T07:01:03.801699+0000","last_became_peered":"2024-09-21T07:01:03.801699+0000","last_unstale":"2024-09-21T07:01:04.767762+0000","last_undegraded":"2024-09-21T07:01:04.767762+0000","last_fullsized":"2024-09-21T07:01:04.767762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:16.741550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767176+0000","last_change":"2024-09-21T07:01:03.779994+0000","last_active":"2024-09-21T07:01:04.767176+0000","last_peered":"2024-09-21T07:01:04.767176+0000","last_clean":"2024-09-21T07:01:04.767176+0000","last_became_active":"2024-09-21T07:01:03.779267+0000","last_became_peered":"2024-09-21T07:01:03.779267+0000","last_unstale":"2024-09-21T07:01:04.767176+0000","last_undegraded":"2024-09-21T07:01:04.767176+0000","last_fullsized":"2024-09-21T07:01:04.767176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:24.747636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843248+0000","last_change":"2024-09-21T07:01:03.799390+0000","last_active":"2024-09-21T07:01:04.843248+0000","last_peered":"2024-09-21T07:01:04.843248+0000","last_clean":"2024-09-21T07:01:04.843248+0000","last_became_active":"2024-09-21T07:01:03.799078+0000","last_became_peered":"2024-09-21T07:01:03.799078+0000","last_unstale":"2024-09-21T07:01:04.843248+0000","last_undegraded":"2024-09-21T07:01:04.843248+0000","last_fullsized":"2024-09-21T07:01:04.843248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:36.565399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843261+0000","last_change":"2024-09-21T07:01:03.800557+0000","last_active":"2024-09-21T07:01:04.843261+0000","last_peered":"2024-09-21T07:01:04.843261+0000","last_clean":"2024-09-21T07:01:04.843261+0000","last_became_active":"2024-09-21T07:01:03.800262+0000","last_became_peered":"2024-09-21T07:01:03.800262+0000","last_unstale":"2024-09-21T07:01:04.843261+0000","last_undegraded":"2024-09-21T07:01:04.843261+0000","last_fullsized":"2024-09-21T07:01:04.843261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:06.031208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844973+0000","last_change":"2024-09-21T07:01:03.781597+0000","last_active":"2024-09-21T07:01:04.844973+0000","last_peered":"2024-09-21T07:01:04.844973+0000","last_clean":"2024-09-21T07:01:04.844973+0000","last_became_active":"2024-09-21T07:01:03.781303+0000","last_became_peered":"2024-09-21T07:01:03.781303+0000","last_unstale":"2024-09-21T07:01:04.844973+0000","last_undegraded":"2024-09-21T07:01:04.844973+0000","last_fullsized":"2024-09-21T07:01:04.844973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:42.573263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843625+0000","last_change":"2024-09-21T07:01:02.778634+0000","last_active":"2024-09-21T07:01:04.843625+0000","last_peered":"2024-09-21T07:01:04.843625+0000","last_clean":"2024-09-21T07:01:04.843625+0000","last_became_active":"2024-09-21T07:01:02.778310+0000","last_became_peered":"2024-09-21T07:01:02.778310+0000","last_unstale":"2024-09-21T07:01:04.843625+0000","last_undegraded":"2024-09-21T07:01:04.843625+0000","last_fullsized":"2024-09-21T07:01:04.843625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:39.995378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844286+0000","last_change":"2024-09-21T07:01:03.801557+0000","last_active":"2024-09-21T07:01:04.844286+0000","last_peered":"2024-09-21T07:01:04.844286+0000","last_clean":"2024-09-21T07:01:04.844286+0000","last_became_active":"2024-09-21T07:01:03.801233+0000","last_became_peered":"2024-09-21T07:01:03.801233+0000","last_unstale":"2024-09-21T07:01:04.844286+0000","last_undegraded":"2024-09-21T07:01:04.844286+0000","last_fullsized":"2024-09-21T07:01:04.844286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:23:01.557172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.763127+0000","last_change":"2024-09-21T07:01:01.763127+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.763127+0000","last_undegraded":"2024-09-21T07:01:01.763127+0000","last_fullsized":"2024-09-21T07:01:01.763127+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844178+0000","last_change":"2024-09-21T07:01:03.799022+0000","last_active":"2024-09-21T07:01:04.844178+0000","last_peered":"2024-09-21T07:01:04.844178+0000","last_clean":"2024-09-21T07:01:04.844178+0000","last_became_active":"2024-09-21T07:01:03.798589+0000","last_became_peered":"2024-09-21T07:01:03.798589+0000","last_unstale":"2024-09-21T07:01:04.844178+0000","last_undegraded":"2024-09-21T07:01:04.844178+0000","last_fullsized":"2024-09-21T07:01:04.844178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:21.629179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.845030+0000","last_change":"2024-09-21T07:01:02.785856+0000","last_active":"2024-09-21T07:01:04.845030+0000","last_peered":"2024-09-21T07:01:04.845030+0000","last_clean":"2024-09-21T07:01:04.845030+0000","last_became_active":"2024-09-21T07:01:02.785426+0000","last_became_peered":"2024-09-21T07:01:02.785426+0000","last_unstale":"2024-09-21T07:01:04.845030+0000","last_undegraded":"2024-09-21T07:01:04.845030+0000","last_fullsized":"2024-09-21T07:01:04.845030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:21.317089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.762932+0000","last_change":"2024-09-21T07:01:01.762932+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.762932+0000","last_undegraded":"2024-09-21T07:01:01.762932+0000","last_fullsized":"2024-09-21T07:01:01.762932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768173+0000","last_change":"2024-09-21T07:01:03.796538+0000","last_active":"2024-09-21T07:01:04.768173+0000","last_peered":"2024-09-21T07:01:04.768173+0000","last_clean":"2024-09-21T07:01:04.768173+0000","last_became_active":"2024-09-21T07:01:03.796196+0000","last_became_peered":"2024-09-21T07:01:03.796196+0000","last_unstale":"2024-09-21T07:01:04.768173+0000","last_undegraded":"2024-09-21T07:01:04.768173+0000","last_fullsized":"2024-09-21T07:01:04.768173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:33.760115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843918+0000","last_change":"2024-09-21T07:01:02.791472+0000","last_active":"2024-09-21T07:01:04.843918+0000","last_peered":"2024-09-21T07:01:04.843918+0000","last_clean":"2024-09-21T07:01:04.843918+0000","last_became_active":"2024-09-21T07:01:02.791087+0000","last_became_peered":"2024-09-21T07:01:02.791087+0000","last_unstale":"2024-09-21T07:01:04.843918+0000","last_undegraded":"2024-09-21T07:01:04.843918+0000","last_fullsized":"2024-09-21T07:01:04.843918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:37.195545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843171+0000","last_change":"2024-09-21T07:01:03.800189+0000","last_active":"2024-09-21T07:01:04.843171+0000","last_peered":"2024-09-21T07:01:04.843171+0000","last_clean":"2024-09-21T07:01:04.843171+0000","last_became_active":"2024-09-21T07:01:03.799901+0000","last_became_peered":"2024-09-21T07:01:03.799901+0000","last_unstale":"2024-09-21T07:01:04.843171+0000","last_undegraded":"2024-09-21T07:01:04.843171+0000","last_fullsized":"2024-09-21T07:01:04.843171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:58.610632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843353+0000","last_change":"2024-09-21T07:01:02.786240+0000","last_active":"2024-09-21T07:01:04.843353+0000","last_peered":"2024-09-21T07:01:04.843353+0000","last_clean":"2024-09-21T07:01:04.843353+0000","last_became_active":"2024-09-21T07:01:02.785829+0000","last_became_peered":"2024-09-21T07:01:02.785829+0000","last_unstale":"2024-09-21T07:01:04.843353+0000","last_undegraded":"2024-09-21T07:01:04.843353+0000","last_fullsized":"2024-09-21T07:01:04.843353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:52.905472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768169+0000","last_change":"2024-09-21T07:01:03.790770+0000","last_active":"2024-09-21T07:01:04.768169+0000","last_peered":"2024-09-21T07:01:04.768169+0000","last_clean":"2024-09-21T07:01:04.768169+0000","last_became_active":"2024-09-21T07:01:03.790466+0000","last_became_peered":"2024-09-21T07:01:03.790466+0000","last_unstale":"2024-09-21T07:01:04.768169+0000","last_undegraded":"2024-09-21T07:01:04.768169+0000","last_fullsized":"2024-09-21T07:01:04.768169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:39.192000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843624+0000","last_change":"2024-09-21T07:01:02.777473+0000","last_active":"2024-09-21T07:01:04.843624+0000","last_peered":"2024-09-21T07:01:04.843624+0000","last_clean":"2024-09-21T07:01:04.843624+0000","last_became_active":"2024-09-21T07:01:02.777116+0000","last_became_peered":"2024-09-21T07:01:02.777116+0000","last_unstale":"2024-09-21T07:01:04.843624+0000","last_undegraded":"2024-09-21T07:01:04.843624+0000","last_fullsized":"2024-09-21T07:01:04.843624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:59:40.790513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843506+0000","last_change":"2024-09-21T07:01:02.783052+0000","last_active":"2024-09-21T07:01:04.843506+0000","last_peered":"2024-09-21T07:01:04.843506+0000","last_clean":"2024-09-21T07:01:04.843506+0000","last_became_active":"2024-09-21T07:01:02.782729+0000","last_became_peered":"2024-09-21T07:01:02.782729+0000","last_unstale":"2024-09-21T07:01:04.843506+0000","last_undegraded":"2024-09-21T07:01:04.843506+0000","last_fullsized":"2024-09-21T07:01:04.843506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.976446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844084+0000","last_change":"2024-09-21T07:01:03.772763+0000","last_active":"2024-09-21T07:01:04.844084+0000","last_peered":"2024-09-21T07:01:04.844084+0000","last_clean":"2024-09-21T07:01:04.844084+0000","last_became_active":"2024-09-21T07:01:03.772413+0000","last_became_peered":"2024-09-21T07:01:03.772413+0000","last_unstale":"2024-09-21T07:01:04.844084+0000","last_undegraded":"2024-09-21T07:01:04.844084+0000","last_fullsized":"2024-09-21T07:01:04.844084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:04.294355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844234+0000","last_change":"2024-09-21T07:01:02.780860+0000","last_active":"2024-09-21T07:01:04.844234+0000","last_peered":"2024-09-21T07:01:04.844234+0000","last_clean":"2024-09-21T07:01:04.844234+0000","last_became_active":"2024-09-21T07:01:02.780296+0000","last_became_peered":"2024-09-21T07:01:02.780296+0000","last_unstale":"2024-09-21T07:01:04.844234+0000","last_undegraded":"2024-09-21T07:01:04.844234+0000","last_fullsized":"2024-09-21T07:01:04.844234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:36.181080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844702+0000","last_change":"2024-09-21T07:01:02.781901+0000","last_active":"2024-09-21T07:01:04.844702+0000","last_peered":"2024-09-21T07:01:04.844702+0000","last_clean":"2024-09-21T07:01:04.844702+0000","last_became_active":"2024-09-21T07:01:02.781563+0000","last_became_peered":"2024-09-21T07:01:02.781563+0000","last_unstale":"2024-09-21T07:01:04.844702+0000","last_undegraded":"2024-09-21T07:01:04.844702+0000","last_fullsized":"2024-09-21T07:01:04.844702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:20.713409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843954+0000","last_change":"2024-09-21T07:01:02.782653+0000","last_active":"2024-09-21T07:01:04.843954+0000","last_peered":"2024-09-21T07:01:04.843954+0000","last_clean":"2024-09-21T07:01:04.843954+0000","last_became_active":"2024-09-21T07:01:02.782261+0000","last_became_peered":"2024-09-21T07:01:02.782261+0000","last_unstale":"2024-09-21T07:01:04.843954+0000","last_undegraded":"2024-09-21T07:01:04.843954+0000","last_fullsized":"2024-09-21T07:01:04.843954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:15.736038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843335+0000","last_change":"2024-09-21T07:01:03.796498+0000","last_active":"2024-09-21T07:01:04.843335+0000","last_peered":"2024-09-21T07:01:04.843335+0000","last_clean":"2024-09-21T07:01:04.843335+0000","last_became_active":"2024-09-21T07:01:03.796169+0000","last_became_peered":"2024-09-21T07:01:03.796169+0000","last_unstale":"2024-09-21T07:01:04.843335+0000","last_undegraded":"2024-09-21T07:01:04.843335+0000","last_fullsized":"2024-09-21T07:01:04.843335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:50.551965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844229+0000","last_change":"2024-09-21T07:01:02.775824+0000","last_active":"2024-09-21T07:01:04.844229+0000","last_peered":"2024-09-21T07:01:04.844229+0000","last_clean":"2024-09-21T07:01:04.844229+0000","last_became_active":"2024-09-21T07:01:02.775228+0000","last_became_peered":"2024-09-21T07:01:02.775228+0000","last_unstale":"2024-09-21T07:01:04.844229+0000","last_undegraded":"2024-09-21T07:01:04.844229+0000","last_fullsized":"2024-09-21T07:01:04.844229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:37.195545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843771+0000","last_change":"2024-09-21T07:01:03.780446+0000","last_active":"2024-09-21T07:01:04.843771+0000","last_peered":"2024-09-21T07:01:04.843771+0000","last_clean":"2024-09-21T07:01:04.843771+0000","last_became_active":"2024-09-21T07:01:03.780180+0000","last_became_peered":"2024-09-21T07:01:03.780180+0000","last_unstale":"2024-09-21T07:01:04.843771+0000","last_undegraded":"2024-09-21T07:01:04.843771+0000","last_fullsized":"2024-09-21T07:01:04.843771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:57.734540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844036+0000","last_change":"2024-09-21T07:01:02.783777+0000","last_active":"2024-09-21T07:01:04.844036+0000","last_peered":"2024-09-21T07:01:04.844036+0000","last_clean":"2024-09-21T07:01:04.844036+0000","last_became_active":"2024-09-21T07:01:02.783438+0000","last_became_peered":"2024-09-21T07:01:02.783438+0000","last_unstale":"2024-09-21T07:01:04.844036+0000","last_undegraded":"2024-09-21T07:01:04.844036+0000","last_fullsized":"2024-09-21T07:01:04.844036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:44.480439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.762490+0000","last_change":"2024-09-21T07:01:01.762490+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.762490+0000","last_undegraded":"2024-09-21T07:01:01.762490+0000","last_fullsized":"2024-09-21T07:01:01.762490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843383+0000","last_change":"2024-09-21T07:01:03.798215+0000","last_active":"2024-09-21T07:01:04.843383+0000","last_peered":"2024-09-21T07:01:04.843383+0000","last_clean":"2024-09-21T07:01:04.843383+0000","last_became_active":"2024-09-21T07:01:03.796516+0000","last_became_peered":"2024-09-21T07:01:03.796516+0000","last_unstale":"2024-09-21T07:01:04.843383+0000","last_undegraded":"2024-09-21T07:01:04.843383+0000","last_fullsized":"2024-09-21T07:01:04.843383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:28.466335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.763414+0000","last_change":"2024-09-21T07:01:01.763414+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.763414+0000","last_undegraded":"2024-09-21T07:01:01.763414+0000","last_fullsized":"2024-09-21T07:01:01.763414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843741+0000","last_change":"2024-09-21T07:01:03.791099+0000","last_active":"2024-09-21T07:01:04.843741+0000","last_peered":"2024-09-21T07:01:04.843741+0000","last_clean":"2024-09-21T07:01:04.843741+0000","last_became_active":"2024-09-21T07:01:03.790772+0000","last_became_peered":"2024-09-21T07:01:03.790772+0000","last_unstale":"2024-09-21T07:01:04.843741+0000","last_undegraded":"2024-09-21T07:01:04.843741+0000","last_fullsized":"2024-09-21T07:01:04.843741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:33.139496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843700+0000","last_change":"2024-09-21T07:01:02.782460+0000","last_active":"2024-09-21T07:01:04.843700+0000","last_peered":"2024-09-21T07:01:04.843700+0000","last_clean":"2024-09-21T07:01:04.843700+0000","last_became_active":"2024-09-21T07:01:02.782160+0000","last_became_peered":"2024-09-21T07:01:02.782160+0000","last_unstale":"2024-09-21T07:01:04.843700+0000","last_undegraded":"2024-09-21T07:01:04.843700+0000","last_fullsized":"2024-09-21T07:01:04.843700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:24.532930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844055+0000","last_change":"2024-09-21T07:01:03.789639+0000","last_active":"2024-09-21T07:01:04.844055+0000","last_peered":"2024-09-21T07:01:04.844055+0000","last_clean":"2024-09-21T07:01:04.844055+0000","last_became_active":"2024-09-21T07:01:03.789329+0000","last_became_peered":"2024-09-21T07:01:03.789329+0000","last_unstale":"2024-09-21T07:01:04.844055+0000","last_undegraded":"2024-09-21T07:01:04.844055+0000","last_fullsized":"2024-09-21T07:01:04.844055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:28.686912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843894+0000","last_change":"2024-09-21T07:01:02.780877+0000","last_active":"2024-09-21T07:01:04.843894+0000","last_peered":"2024-09-21T07:01:04.843894+0000","last_clean":"2024-09-21T07:01:04.843894+0000","last_became_active":"2024-09-21T07:01:02.780530+0000","last_became_peered":"2024-09-21T07:01:02.780530+0000","last_unstale":"2024-09-21T07:01:04.843894+0000","last_undegraded":"2024-09-21T07:01:04.843894+0000","last_fullsized":"2024-09-21T07:01:04.843894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:28.933785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768917+0000","last_change":"2024-09-21T07:01:03.790197+0000","last_active":"2024-09-21T07:01:04.768917+0000","last_peered":"2024-09-21T07:01:04.768917+0000","last_clean":"2024-09-21T07:01:04.768917+0000","last_became_active":"2024-09-21T07:01:03.789769+0000","last_became_peered":"2024-09-21T07:01:03.789769+0000","last_unstale":"2024-09-21T07:01:04.768917+0000","last_undegraded":"2024-09-21T07:01:04.768917+0000","last_fullsized":"2024-09-21T07:01:04.768917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:32.176127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844415+0000","last_change":"2024-09-21T07:01:02.792339+0000","last_active":"2024-09-21T07:01:04.844415+0000","last_peered":"2024-09-21T07:01:04.844415+0000","last_clean":"2024-09-21T07:01:04.844415+0000","last_became_active":"2024-09-21T07:01:02.791971+0000","last_became_peered":"2024-09-21T07:01:02.791971+0000","last_unstale":"2024-09-21T07:01:04.844415+0000","last_undegraded":"2024-09-21T07:01:04.844415+0000","last_fullsized":"2024-09-21T07:01:04.844415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:43.713520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844168+0000","last_change":"2024-09-21T07:01:03.782318+0000","last_active":"2024-09-21T07:01:04.844168+0000","last_peered":"2024-09-21T07:01:04.844168+0000","last_clean":"2024-09-21T07:01:04.844168+0000","last_became_active":"2024-09-21T07:01:03.781942+0000","last_became_peered":"2024-09-21T07:01:03.781942+0000","last_unstale":"2024-09-21T07:01:04.844168+0000","last_undegraded":"2024-09-21T07:01:04.844168+0000","last_fullsized":"2024-09-21T07:01:04.844168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:34.894160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843829+0000","last_change":"2024-09-21T07:01:02.779001+0000","last_active":"2024-09-21T07:01:04.843829+0000","last_peered":"2024-09-21T07:01:04.843829+0000","last_clean":"2024-09-21T07:01:04.843829+0000","last_became_active":"2024-09-21T07:01:02.778522+0000","last_became_peered":"2024-09-21T07:01:02.778522+0000","last_unstale":"2024-09-21T07:01:04.843829+0000","last_undegraded":"2024-09-21T07:01:04.843829+0000","last_fullsized":"2024-09-21T07:01:04.843829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:03.188520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844992+0000","last_change":"2024-09-21T07:01:03.790572+0000","last_active":"2024-09-21T07:01:04.844992+0000","last_peered":"2024-09-21T07:01:04.844992+0000","last_clean":"2024-09-21T07:01:04.844992+0000","last_became_active":"2024-09-21T07:01:03.790070+0000","last_became_peered":"2024-09-21T07:01:03.790070+0000","last_unstale":"2024-09-21T07:01:04.844992+0000","last_undegraded":"2024-09-21T07:01:04.844992+0000","last_fullsized":"2024-09-21T07:01:04.844992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:40.124786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767672+0000","last_change":"2024-09-21T07:01:02.778072+0000","last_active":"2024-09-21T07:01:04.767672+0000","last_peered":"2024-09-21T07:01:04.767672+0000","last_clean":"2024-09-21T07:01:04.767672+0000","last_became_active":"2024-09-21T07:01:02.777714+0000","last_became_peered":"2024-09-21T07:01:02.777714+0000","last_unstale":"2024-09-21T07:01:04.767672+0000","last_undegraded":"2024-09-21T07:01:04.767672+0000","last_fullsized":"2024-09-21T07:01:04.767672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:05.574202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844019+0000","last_change":"2024-09-21T07:01:03.792264+0000","last_active":"2024-09-21T07:01:04.844019+0000","last_peered":"2024-09-21T07:01:04.844019+0000","last_clean":"2024-09-21T07:01:04.844019+0000","last_became_active":"2024-09-21T07:01:03.791787+0000","last_became_peered":"2024-09-21T07:01:03.791787+0000","last_unstale":"2024-09-21T07:01:04.844019+0000","last_undegraded":"2024-09-21T07:01:04.844019+0000","last_fullsized":"2024-09-21T07:01:04.844019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843915+0000","last_change":"2024-09-21T07:01:02.778713+0000","last_active":"2024-09-21T07:01:04.843915+0000","last_peered":"2024-09-21T07:01:04.843915+0000","last_clean":"2024-09-21T07:01:04.843915+0000","last_became_active":"2024-09-21T07:01:02.778375+0000","last_became_peered":"2024-09-21T07:01:02.778375+0000","last_unstale":"2024-09-21T07:01:04.843915+0000","last_undegraded":"2024-09-21T07:01:04.843915+0000","last_fullsized":"2024-09-21T07:01:04.843915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:41.462449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843779+0000","last_change":"2024-09-21T07:01:03.777959+0000","last_active":"2024-09-21T07:01:04.843779+0000","last_peered":"2024-09-21T07:01:04.843779+0000","last_clean":"2024-09-21T07:01:04.843779+0000","last_became_active":"2024-09-21T07:01:03.777648+0000","last_became_peered":"2024-09-21T07:01:03.777648+0000","last_unstale":"2024-09-21T07:01:04.843779+0000","last_undegraded":"2024-09-21T07:01:04.843779+0000","last_fullsized":"2024-09-21T07:01:04.843779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:11.993232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843470+0000","last_change":"2024-09-21T07:01:02.792375+0000","last_active":"2024-09-21T07:01:04.843470+0000","last_peered":"2024-09-21T07:01:04.843470+0000","last_clean":"2024-09-21T07:01:04.843470+0000","last_became_active":"2024-09-21T07:01:02.792035+0000","last_became_peered":"2024-09-21T07:01:02.792035+0000","last_unstale":"2024-09-21T07:01:04.843470+0000","last_undegraded":"2024-09-21T07:01:04.843470+0000","last_fullsized":"2024-09-21T07:01:04.843470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:38.186488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843785+0000","last_change":"2024-09-21T07:01:03.788441+0000","last_active":"2024-09-21T07:01:04.843785+0000","last_peered":"2024-09-21T07:01:04.843785+0000","last_clean":"2024-09-21T07:01:04.843785+0000","last_became_active":"2024-09-21T07:01:03.788130+0000","last_became_peered":"2024-09-21T07:01:03.788130+0000","last_unstale":"2024-09-21T07:01:04.843785+0000","last_undegraded":"2024-09-21T07:01:04.843785+0000","last_fullsized":"2024-09-21T07:01:04.843785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:13.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768417+0000","last_change":"2024-09-21T07:01:02.776793+0000","last_active":"2024-09-21T07:01:04.768417+0000","last_peered":"2024-09-21T07:01:04.768417+0000","last_clean":"2024-09-21T07:01:04.768417+0000","last_became_active":"2024-09-21T07:01:02.775460+0000","last_became_peered":"2024-09-21T07:01:02.775460+0000","last_unstale":"2024-09-21T07:01:04.768417+0000","last_undegraded":"2024-09-21T07:01:04.768417+0000","last_fullsized":"2024-09-21T07:01:04.768417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:05.467271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768307+0000","last_change":"2024-09-21T07:01:03.791274+0000","last_active":"2024-09-21T07:01:04.768307+0000","last_peered":"2024-09-21T07:01:04.768307+0000","last_clean":"2024-09-21T07:01:04.768307+0000","last_became_active":"2024-09-21T07:01:03.790995+0000","last_became_peered":"2024-09-21T07:01:03.790995+0000","last_unstale":"2024-09-21T07:01:04.768307+0000","last_undegraded":"2024-09-21T07:01:04.768307+0000","last_fullsized":"2024-09-21T07:01:04.768307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:52.515976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843395+0000","last_change":"2024-09-21T07:01:02.781006+0000","last_active":"2024-09-21T07:01:04.843395+0000","last_peered":"2024-09-21T07:01:04.843395+0000","last_clean":"2024-09-21T07:01:04.843395+0000","last_became_active":"2024-09-21T07:01:02.780061+0000","last_became_peered":"2024-09-21T07:01:02.780061+0000","last_unstale":"2024-09-21T07:01:04.843395+0000","last_undegraded":"2024-09-21T07:01:04.843395+0000","last_fullsized":"2024-09-21T07:01:04.843395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:26.121246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844799+0000","last_change":"2024-09-21T07:01:03.790603+0000","last_active":"2024-09-21T07:01:04.844799+0000","last_peered":"2024-09-21T07:01:04.844799+0000","last_clean":"2024-09-21T07:01:04.844799+0000","last_became_active":"2024-09-21T07:01:03.790244+0000","last_became_peered":"2024-09-21T07:01:03.790244+0000","last_unstale":"2024-09-21T07:01:04.844799+0000","last_undegraded":"2024-09-21T07:01:04.844799+0000","last_fullsized":"2024-09-21T07:01:04.844799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:07.386079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843927+0000","last_change":"2024-09-21T07:01:02.790264+0000","last_active":"2024-09-21T07:01:04.843927+0000","last_peered":"2024-09-21T07:01:04.843927+0000","last_clean":"2024-09-21T07:01:04.843927+0000","last_became_active":"2024-09-21T07:01:02.789872+0000","last_became_peered":"2024-09-21T07:01:02.789872+0000","last_unstale":"2024-09-21T07:01:04.843927+0000","last_undegraded":"2024-09-21T07:01:04.843927+0000","last_fullsized":"2024-09-21T07:01:04.843927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.976446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843758+0000","last_change":"2024-09-21T07:01:03.781029+0000","last_active":"2024-09-21T07:01:04.843758+0000","last_peered":"2024-09-21T07:01:04.843758+0000","last_clean":"2024-09-21T07:01:04.843758+0000","last_became_active":"2024-09-21T07:01:03.780695+0000","last_became_peered":"2024-09-21T07:01:03.780695+0000","last_unstale":"2024-09-21T07:01:04.843758+0000","last_undegraded":"2024-09-21T07:01:04.843758+0000","last_fullsized":"2024-09-21T07:01:04.843758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:24.208627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844717+0000","last_change":"2024-09-21T07:01:02.781328+0000","last_active":"2024-09-21T07:01:04.844717+0000","last_peered":"2024-09-21T07:01:04.844717+0000","last_clean":"2024-09-21T07:01:04.844717+0000","last_became_active":"2024-09-21T07:01:02.780299+0000","last_became_peered":"2024-09-21T07:01:02.780299+0000","last_unstale":"2024-09-21T07:01:04.844717+0000","last_undegraded":"2024-09-21T07:01:04.844717+0000","last_fullsized":"2024-09-21T07:01:04.844717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:56.729028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844953+0000","last_change":"2024-09-21T07:01:03.795504+0000","last_active":"2024-09-21T07:01:04.844953+0000","last_peered":"2024-09-21T07:01:04.844953+0000","last_clean":"2024-09-21T07:01:04.844953+0000","last_became_active":"2024-09-21T07:01:03.795137+0000","last_became_peered":"2024-09-21T07:01:03.795137+0000","last_unstale":"2024-09-21T07:01:04.844953+0000","last_undegraded":"2024-09-21T07:01:04.844953+0000","last_fullsized":"2024-09-21T07:01:04.844953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:35.892752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844355+0000","last_change":"2024-09-21T07:01:02.778586+0000","last_active":"2024-09-21T07:01:04.844355+0000","last_peered":"2024-09-21T07:01:04.844355+0000","last_clean":"2024-09-21T07:01:04.844355+0000","last_became_active":"2024-09-21T07:01:02.778221+0000","last_became_peered":"2024-09-21T07:01:02.778221+0000","last_unstale":"2024-09-21T07:01:04.844355+0000","last_undegraded":"2024-09-21T07:01:04.844355+0000","last_fullsized":"2024-09-21T07:01:04.844355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:31.170615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767423+0000","last_change":"2024-09-21T07:01:03.779595+0000","last_active":"2024-09-21T07:01:04.767423+0000","last_peered":"2024-09-21T07:01:04.767423+0000","last_clean":"2024-09-21T07:01:04.767423+0000","last_became_active":"2024-09-21T07:01:03.778855+0000","last_became_peered":"2024-09-21T07:01:03.778855+0000","last_unstale":"2024-09-21T07:01:04.767423+0000","last_undegraded":"2024-09-21T07:01:04.767423+0000","last_fullsized":"2024-09-21T07:01:04.767423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:43.811241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844675+0000","last_change":"2024-09-21T07:01:02.790214+0000","last_active":"2024-09-21T07:01:04.844675+0000","last_peered":"2024-09-21T07:01:04.844675+0000","last_clean":"2024-09-21T07:01:04.844675+0000","last_became_active":"2024-09-21T07:01:02.789887+0000","last_became_peered":"2024-09-21T07:01:02.789887+0000","last_unstale":"2024-09-21T07:01:04.844675+0000","last_undegraded":"2024-09-21T07:01:04.844675+0000","last_fullsized":"2024-09-21T07:01:04.844675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:51.510464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844153+0000","last_change":"2024-09-21T07:01:02.777740+0000","last_active":"2024-09-21T07:01:04.844153+0000","last_peered":"2024-09-21T07:01:04.844153+0000","last_clean":"2024-09-21T07:01:04.844153+0000","last_became_active":"2024-09-21T07:01:02.777294+0000","last_became_peered":"2024-09-21T07:01:02.777294+0000","last_unstale":"2024-09-21T07:01:04.844153+0000","last_undegraded":"2024-09-21T07:01:04.844153+0000","last_fullsized":"2024-09-21T07:01:04.844153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:44.480439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843373+0000","last_change":"2024-09-21T07:01:02.792247+0000","last_active":"2024-09-21T07:01:04.843373+0000","last_peered":"2024-09-21T07:01:04.843373+0000","last_clean":"2024-09-21T07:01:04.843373+0000","last_became_active":"2024-09-21T07:01:02.791859+0000","last_became_peered":"2024-09-21T07:01:02.791859+0000","last_unstale":"2024-09-21T07:01:04.843373+0000","last_undegraded":"2024-09-21T07:01:04.843373+0000","last_fullsized":"2024-09-21T07:01:04.843373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:51.510464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843787+0000","last_change":"2024-09-21T07:01:03.782839+0000","last_active":"2024-09-21T07:01:04.843787+0000","last_peered":"2024-09-21T07:01:04.843787+0000","last_clean":"2024-09-21T07:01:04.843787+0000","last_became_active":"2024-09-21T07:01:03.782446+0000","last_became_peered":"2024-09-21T07:01:03.782446+0000","last_unstale":"2024-09-21T07:01:04.843787+0000","last_undegraded":"2024-09-21T07:01:04.843787+0000","last_fullsized":"2024-09-21T07:01:04.843787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:29.430348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.762492+0000","last_change":"2024-09-21T07:01:01.762492+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.762492+0000","last_undegraded":"2024-09-21T07:01:01.762492+0000","last_fullsized":"2024-09-21T07:01:01.762492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767690+0000","last_change":"2024-09-21T07:01:03.788278+0000","last_active":"2024-09-21T07:01:04.767690+0000","last_peered":"2024-09-21T07:01:04.767690+0000","last_clean":"2024-09-21T07:01:04.767690+0000","last_became_active":"2024-09-21T07:01:03.787728+0000","last_became_peered":"2024-09-21T07:01:03.787728+0000","last_unstale":"2024-09-21T07:01:04.767690+0000","last_undegraded":"2024-09-21T07:01:04.767690+0000","last_fullsized":"2024-09-21T07:01:04.767690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:04.194032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843977+0000","last_change":"2024-09-21T07:01:02.779208+0000","last_active":"2024-09-21T07:01:04.843977+0000","last_peered":"2024-09-21T07:01:04.843977+0000","last_clean":"2024-09-21T07:01:04.843977+0000","last_became_active":"2024-09-21T07:01:02.778011+0000","last_became_peered":"2024-09-21T07:01:02.778011+0000","last_unstale":"2024-09-21T07:01:04.843977+0000","last_undegraded":"2024-09-21T07:01:04.843977+0000","last_fullsized":"2024-09-21T07:01:04.843977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:04.375217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767896+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:01:04.767896+0000","last_peered":"2024-09-21T07:01:04.767896+0000","last_clean":"2024-09-21T07:01:04.767896+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:01:04.767896+0000","last_undegraded":"2024-09-21T07:01:04.767896+0000","last_fullsized":"2024-09-21T07:01:04.767896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":133486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,11],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":364544,"data_stored":135076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":730714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":134240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":133498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":730202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":133554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:01:08.220 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:01:08.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.371+0000 7f4a65470640 1 -- 172.21.15.63:0/1154926257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a600c61e0 msgr2=0x7f4a600d0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.371+0000 7f4a65470640 1 --2- 172.21.15.63:0/1154926257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a600c61e0 0x7f4a600d0290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4a600d07d0 tx=0x7f4a5002aac0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.371+0000 7f4a65470640 1 -- 172.21.15.63:0/1154926257 shutdown_connections 2024-09-21T07:01:08.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.371+0000 7f4a65470640 1 --2- 172.21.15.63:0/1154926257 >> v2:172.21.15.71:3300/0 conn(0x7f4a600cfa50 0x7f4a600b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.371+0000 7f4a65470640 1 --2- 172.21.15.63:0/1154926257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a600c61e0 0x7f4a600d0290 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.371+0000 7f4a65470640 1 -- 172.21.15.63:0/1154926257 >> 172.21.15.63:0/1154926257 conn(0x7f4a600b2f70 msgr2=0x7f4a600b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:08.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.371+0000 7f4a65470640 1 -- 172.21.15.63:0/1154926257 shutdown_connections 2024-09-21T07:01:08.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.371+0000 7f4a65470640 1 -- 172.21.15.63:0/1154926257 wait complete. 2024-09-21T07:01:08.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.373+0000 7f4a65470640 1 Processor -- start 2024-09-21T07:01:08.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.373+0000 7f4a65470640 1 -- start start 2024-09-21T07:01:08.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a65470640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a600c61e0 0x7f4a600ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:08.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a65470640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4a600cf640 0x7f4a6009dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:08.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a65470640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a600cfa50 0x7f4a60148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:08.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a65470640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6015f880 con 0x7f4a600c61e0 2024-09-21T07:01:08.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a65470640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6015f700 con 0x7f4a600cfa50 2024-09-21T07:01:08.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a65470640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4a6015fa00 con 0x7f4a600cf640 2024-09-21T07:01:08.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a5effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a600c61e0 0x7f4a600ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:08.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a5effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a600c61e0 0x7f4a600ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39082/0 (socket says 172.21.15.63:39082) 2024-09-21T07:01:08.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a5effd640 1 -- 172.21.15.63:0/569454215 learned_addr learned my addr 172.21.15.63:0/569454215 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:08.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a5e7fc640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4a600cf640 0x7f4a6009dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a5f7fe640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a600cfa50 0x7f4a60148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a5effd640 1 -- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4a600cf640 msgr2=0x7f4a6009dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a5effd640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4a600cf640 0x7f4a6009dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a5effd640 1 -- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a600cfa50 msgr2=0x7f4a60148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a5effd640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a600cfa50 0x7f4a60148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a5effd640 1 -- 172.21.15.63:0/569454215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6009cab0 con 0x7f4a600c61e0 2024-09-21T07:01:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a5f7fe640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a600cfa50 0x7f4a60148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.375+0000 7f4a5effd640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a600c61e0 0x7f4a600ce8d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009bf0 tx=0x7f4a50003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.376+0000 7f4a577fe640 1 -- 172.21.15.63:0/569454215 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50044070 con 0x7f4a600c61e0 2024-09-21T07:01:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.376+0000 7f4a577fe640 1 -- 172.21.15.63:0/569454215 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a50004250 con 0x7f4a600c61e0 2024-09-21T07:01:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.376+0000 7f4a65470640 1 -- 172.21.15.63:0/569454215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a6009cf50 con 0x7f4a600c61e0 2024-09-21T07:01:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.376+0000 7f4a577fe640 1 -- 172.21.15.63:0/569454215 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50004680 con 0x7f4a600c61e0 2024-09-21T07:01:08.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.376+0000 7f4a65470640 1 -- 172.21.15.63:0/569454215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a6009d510 con 0x7f4a600c61e0 2024-09-21T07:01:08.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.377+0000 7f4a65470640 1 -- 172.21.15.63:0/569454215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a600c77e0 con 0x7f4a600c61e0 2024-09-21T07:01:08.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.377+0000 7f4a577fe640 1 -- 172.21.15.63:0/569454215 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4a50036400 con 0x7f4a600c61e0 2024-09-21T07:01:08.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.378+0000 7f4a577fe640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4a40078b90 0x7f4a4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:08.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.378+0000 7f4a577fe640 1 -- 172.21.15.63:0/569454215 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4a500bb490 con 0x7f4a600c61e0 2024-09-21T07:01:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.378+0000 7f4a5e7fc640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4a40078b90 0x7f4a4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:08.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.379+0000 7f4a5e7fc640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4a40078b90 0x7f4a4007b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4a6015d360 tx=0x7f4a48009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:08.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.382+0000 7f4a577fe640 1 -- 172.21.15.63:0/569454215 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4a600c77e0 con 0x7f4a600c61e0 2024-09-21T07:01:08.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.570+0000 7f4a65470640 1 -- 172.21.15.63:0/569454215 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a600d0290 con 0x7f4a40078b90 2024-09-21T07:01:08.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.574+0000 7f4a577fe640 1 -- 172.21.15.63:0/569454215 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249933 (secure 0 0 0) 0x7f4a600d0290 con 0x7f4a40078b90 2024-09-21T07:01:08.578 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:08.580 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:01:08.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.577+0000 7f4a65470640 1 -- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4a40078b90 msgr2=0x7f4a4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.577+0000 7f4a65470640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4a40078b90 0x7f4a4007b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4a6015d360 tx=0x7f4a48009040 comp rx=0 tx=0).stop 2024-09-21T07:01:08.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.577+0000 7f4a65470640 1 -- 172.21.15.63:0/569454215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a600c61e0 msgr2=0x7f4a600ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.577+0000 7f4a65470640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a600c61e0 0x7f4a600ce8d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009bf0 tx=0x7f4a50003f10 comp rx=0 tx=0).stop 2024-09-21T07:01:08.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.577+0000 7f4a65470640 1 -- 172.21.15.63:0/569454215 shutdown_connections 2024-09-21T07:01:08.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.577+0000 7f4a65470640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4a40078b90 0x7f4a4007b0a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.577+0000 7f4a65470640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4a600cfa50 0x7f4a60148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.577+0000 7f4a65470640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4a600cf640 0x7f4a6009dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.577+0000 7f4a65470640 1 --2- 172.21.15.63:0/569454215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a600c61e0 0x7f4a600ce8d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.577+0000 7f4a65470640 1 -- 172.21.15.63:0/569454215 >> 172.21.15.63:0/569454215 conn(0x7f4a600b2f70 msgr2=0x7f4a6015d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:08.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.578+0000 7f4a65470640 1 -- 172.21.15.63:0/569454215 shutdown_connections 2024-09-21T07:01:08.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.578+0000 7f4a65470640 1 -- 172.21.15.63:0/569454215 wait complete. 2024-09-21T07:01:08.591 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-21T07:01:06.608025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":142,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220224,"kb_used_data":3960,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754496,"statfs":{"total":773094113280,"available":772868603904,"internally_reserved":0,"allocated":4055040,"data_stored":2251184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,11],"upper_bound":32},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.847185"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844066+0000","last_change":"2024-09-21T07:01:03.794142+0000","last_active":"2024-09-21T07:01:04.844066+0000","last_peered":"2024-09-21T07:01:04.844066+0000","last_clean":"2024-09-21T07:01:04.844066+0000","last_became_active":"2024-09-21T07:01:03.790316+0000","last_became_peered":"2024-09-21T07:01:03.790316+0000","last_unstale":"2024-09-21T07:01:04.844066+0000","last_undegraded":"2024-09-21T07:01:04.844066+0000","last_fullsized":"2024-09-21T07:01:04.844066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:19.787933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844566+0000","last_change":"2024-09-21T07:01:03.791660+0000","last_active":"2024-09-21T07:01:04.844566+0000","last_peered":"2024-09-21T07:01:04.844566+0000","last_clean":"2024-09-21T07:01:04.844566+0000","last_became_active":"2024-09-21T07:01:03.790741+0000","last_became_peered":"2024-09-21T07:01:03.790741+0000","last_unstale":"2024-09-21T07:01:04.844566+0000","last_undegraded":"2024-09-21T07:01:04.844566+0000","last_fullsized":"2024-09-21T07:01:04.844566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.262768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768560+0000","last_change":"2024-09-21T07:01:03.792492+0000","last_active":"2024-09-21T07:01:04.768560+0000","last_peered":"2024-09-21T07:01:04.768560+0000","last_clean":"2024-09-21T07:01:04.768560+0000","last_became_active":"2024-09-21T07:01:03.792164+0000","last_became_peered":"2024-09-21T07:01:03.792164+0000","last_unstale":"2024-09-21T07:01:04.768560+0000","last_undegraded":"2024-09-21T07:01:04.768560+0000","last_fullsized":"2024-09-21T07:01:04.768560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:38.201057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843541+0000","last_change":"2024-09-21T07:01:03.775605+0000","last_active":"2024-09-21T07:01:04.843541+0000","last_peered":"2024-09-21T07:01:04.843541+0000","last_clean":"2024-09-21T07:01:04.843541+0000","last_became_active":"2024-09-21T07:01:03.775096+0000","last_became_peered":"2024-09-21T07:01:03.775096+0000","last_unstale":"2024-09-21T07:01:04.843541+0000","last_undegraded":"2024-09-21T07:01:04.843541+0000","last_fullsized":"2024-09-21T07:01:04.843541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:23.836413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844759+0000","last_change":"2024-09-21T07:01:03.801253+0000","last_active":"2024-09-21T07:01:04.844759+0000","last_peered":"2024-09-21T07:01:04.844759+0000","last_clean":"2024-09-21T07:01:04.844759+0000","last_became_active":"2024-09-21T07:01:03.800920+0000","last_became_peered":"2024-09-21T07:01:03.800920+0000","last_unstale":"2024-09-21T07:01:04.844759+0000","last_undegraded":"2024-09-21T07:01:04.844759+0000","last_fullsized":"2024-09-21T07:01:04.844759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:42.751536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843408+0000","last_change":"2024-09-21T07:01:03.795428+0000","last_active":"2024-09-21T07:01:04.843408+0000","last_peered":"2024-09-21T07:01:04.843408+0000","last_clean":"2024-09-21T07:01:04.843408+0000","last_became_active":"2024-09-21T07:01:03.795098+0000","last_became_peered":"2024-09-21T07:01:03.795098+0000","last_unstale":"2024-09-21T07:01:04.843408+0000","last_undegraded":"2024-09-21T07:01:04.843408+0000","last_fullsized":"2024-09-21T07:01:04.843408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843685+0000","last_change":"2024-09-21T07:01:03.795965+0000","last_active":"2024-09-21T07:01:04.843685+0000","last_peered":"2024-09-21T07:01:04.843685+0000","last_clean":"2024-09-21T07:01:04.843685+0000","last_became_active":"2024-09-21T07:01:03.795485+0000","last_became_peered":"2024-09-21T07:01:03.795485+0000","last_unstale":"2024-09-21T07:01:04.843685+0000","last_undegraded":"2024-09-21T07:01:04.843685+0000","last_fullsized":"2024-09-21T07:01:04.843685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:45.129827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768692+0000","last_change":"2024-09-21T07:01:03.797379+0000","last_active":"2024-09-21T07:01:04.768692+0000","last_peered":"2024-09-21T07:01:04.768692+0000","last_clean":"2024-09-21T07:01:04.768692+0000","last_became_active":"2024-09-21T07:01:03.797038+0000","last_became_peered":"2024-09-21T07:01:03.797038+0000","last_unstale":"2024-09-21T07:01:04.768692+0000","last_undegraded":"2024-09-21T07:01:04.768692+0000","last_fullsized":"2024-09-21T07:01:04.768692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.981958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843680+0000","last_change":"2024-09-21T07:01:03.797615+0000","last_active":"2024-09-21T07:01:04.843680+0000","last_peered":"2024-09-21T07:01:04.843680+0000","last_clean":"2024-09-21T07:01:04.843680+0000","last_became_active":"2024-09-21T07:01:03.796962+0000","last_became_peered":"2024-09-21T07:01:03.796962+0000","last_unstale":"2024-09-21T07:01:04.843680+0000","last_undegraded":"2024-09-21T07:01:04.843680+0000","last_fullsized":"2024-09-21T07:01:04.843680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:29.202843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768150+0000","last_change":"2024-09-21T07:01:03.788053+0000","last_active":"2024-09-21T07:01:04.768150+0000","last_peered":"2024-09-21T07:01:04.768150+0000","last_clean":"2024-09-21T07:01:04.768150+0000","last_became_active":"2024-09-21T07:01:03.787728+0000","last_became_peered":"2024-09-21T07:01:03.787728+0000","last_unstale":"2024-09-21T07:01:04.768150+0000","last_undegraded":"2024-09-21T07:01:04.768150+0000","last_fullsized":"2024-09-21T07:01:04.768150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:44.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844461+0000","last_change":"2024-09-21T07:01:03.792564+0000","last_active":"2024-09-21T07:01:04.844461+0000","last_peered":"2024-09-21T07:01:04.844461+0000","last_clean":"2024-09-21T07:01:04.844461+0000","last_became_active":"2024-09-21T07:01:03.791629+0000","last_became_peered":"2024-09-21T07:01:03.791629+0000","last_unstale":"2024-09-21T07:01:04.844461+0000","last_undegraded":"2024-09-21T07:01:04.844461+0000","last_fullsized":"2024-09-21T07:01:04.844461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:58.610632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767157+0000","last_change":"2024-09-21T07:01:03.801933+0000","last_active":"2024-09-21T07:01:04.767157+0000","last_peered":"2024-09-21T07:01:04.767157+0000","last_clean":"2024-09-21T07:01:04.767157+0000","last_became_active":"2024-09-21T07:01:03.801563+0000","last_became_peered":"2024-09-21T07:01:03.801563+0000","last_unstale":"2024-09-21T07:01:04.767157+0000","last_undegraded":"2024-09-21T07:01:04.767157+0000","last_fullsized":"2024-09-21T07:01:04.767157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:34.894160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767121+0000","last_change":"2024-09-21T07:01:03.787523+0000","last_active":"2024-09-21T07:01:04.767121+0000","last_peered":"2024-09-21T07:01:04.767121+0000","last_clean":"2024-09-21T07:01:04.767121+0000","last_became_active":"2024-09-21T07:01:03.786731+0000","last_became_peered":"2024-09-21T07:01:03.786731+0000","last_unstale":"2024-09-21T07:01:04.767121+0000","last_undegraded":"2024-09-21T07:01:04.767121+0000","last_fullsized":"2024-09-21T07:01:04.767121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:11.993232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843403+0000","last_change":"2024-09-21T07:01:03.799976+0000","last_active":"2024-09-21T07:01:04.843403+0000","last_peered":"2024-09-21T07:01:04.843403+0000","last_clean":"2024-09-21T07:01:04.843403+0000","last_became_active":"2024-09-21T07:01:03.799425+0000","last_became_peered":"2024-09-21T07:01:03.799425+0000","last_unstale":"2024-09-21T07:01:04.843403+0000","last_undegraded":"2024-09-21T07:01:04.843403+0000","last_fullsized":"2024-09-21T07:01:04.843403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:37.275079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844401+0000","last_change":"2024-09-21T07:01:03.781832+0000","last_active":"2024-09-21T07:01:04.844401+0000","last_peered":"2024-09-21T07:01:04.844401+0000","last_clean":"2024-09-21T07:01:04.844401+0000","last_became_active":"2024-09-21T07:01:03.779709+0000","last_became_peered":"2024-09-21T07:01:03.779709+0000","last_unstale":"2024-09-21T07:01:04.844401+0000","last_undegraded":"2024-09-21T07:01:04.844401+0000","last_fullsized":"2024-09-21T07:01:04.844401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:04.995003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844689+0000","last_change":"2024-09-21T07:01:03.788320+0000","last_active":"2024-09-21T07:01:04.844689+0000","last_peered":"2024-09-21T07:01:04.844689+0000","last_clean":"2024-09-21T07:01:04.844689+0000","last_became_active":"2024-09-21T07:01:03.787978+0000","last_became_peered":"2024-09-21T07:01:03.787978+0000","last_unstale":"2024-09-21T07:01:04.844689+0000","last_undegraded":"2024-09-21T07:01:04.844689+0000","last_fullsized":"2024-09-21T07:01:04.844689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:18.875542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844064+0000","last_change":"2024-09-21T07:01:03.792145+0000","last_active":"2024-09-21T07:01:04.844064+0000","last_peered":"2024-09-21T07:01:04.844064+0000","last_clean":"2024-09-21T07:01:04.844064+0000","last_became_active":"2024-09-21T07:01:03.791766+0000","last_became_peered":"2024-09-21T07:01:03.791766+0000","last_unstale":"2024-09-21T07:01:04.844064+0000","last_undegraded":"2024-09-21T07:01:04.844064+0000","last_fullsized":"2024-09-21T07:01:04.844064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:45.001116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767414+0000","last_change":"2024-09-21T07:01:03.788762+0000","last_active":"2024-09-21T07:01:04.767414+0000","last_peered":"2024-09-21T07:01:04.767414+0000","last_clean":"2024-09-21T07:01:04.767414+0000","last_became_active":"2024-09-21T07:01:03.788372+0000","last_became_peered":"2024-09-21T07:01:03.788372+0000","last_unstale":"2024-09-21T07:01:04.767414+0000","last_undegraded":"2024-09-21T07:01:04.767414+0000","last_fullsized":"2024-09-21T07:01:04.767414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:19.787933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843211+0000","last_change":"2024-09-21T07:01:03.799507+0000","last_active":"2024-09-21T07:01:04.843211+0000","last_peered":"2024-09-21T07:01:04.843211+0000","last_clean":"2024-09-21T07:01:04.843211+0000","last_became_active":"2024-09-21T07:01:03.798713+0000","last_became_peered":"2024-09-21T07:01:03.798713+0000","last_unstale":"2024-09-21T07:01:04.843211+0000","last_undegraded":"2024-09-21T07:01:04.843211+0000","last_fullsized":"2024-09-21T07:01:04.843211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:42.573263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843765+0000","last_change":"2024-09-21T07:01:03.781265+0000","last_active":"2024-09-21T07:01:04.843765+0000","last_peered":"2024-09-21T07:01:04.843765+0000","last_clean":"2024-09-21T07:01:04.843765+0000","last_became_active":"2024-09-21T07:01:03.780969+0000","last_became_peered":"2024-09-21T07:01:03.780969+0000","last_unstale":"2024-09-21T07:01:04.843765+0000","last_undegraded":"2024-09-21T07:01:04.843765+0000","last_fullsized":"2024-09-21T07:01:04.843765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:59.851233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843141+0000","last_change":"2024-09-21T07:01:03.799128+0000","last_active":"2024-09-21T07:01:04.843141+0000","last_peered":"2024-09-21T07:01:04.843141+0000","last_clean":"2024-09-21T07:01:04.843141+0000","last_became_active":"2024-09-21T07:01:03.798706+0000","last_became_peered":"2024-09-21T07:01:03.798706+0000","last_unstale":"2024-09-21T07:01:04.843141+0000","last_undegraded":"2024-09-21T07:01:04.843141+0000","last_fullsized":"2024-09-21T07:01:04.843141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:56.371767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844561+0000","last_change":"2024-09-21T07:01:03.789643+0000","last_active":"2024-09-21T07:01:04.844561+0000","last_peered":"2024-09-21T07:01:04.844561+0000","last_clean":"2024-09-21T07:01:04.844561+0000","last_became_active":"2024-09-21T07:01:03.789249+0000","last_became_peered":"2024-09-21T07:01:03.789249+0000","last_unstale":"2024-09-21T07:01:04.844561+0000","last_undegraded":"2024-09-21T07:01:04.844561+0000","last_fullsized":"2024-09-21T07:01:04.844561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:24.747636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844048+0000","last_change":"2024-09-21T07:01:03.793850+0000","last_active":"2024-09-21T07:01:04.844048+0000","last_peered":"2024-09-21T07:01:04.844048+0000","last_clean":"2024-09-21T07:01:04.844048+0000","last_became_active":"2024-09-21T07:01:03.790220+0000","last_became_peered":"2024-09-21T07:01:03.790220+0000","last_unstale":"2024-09-21T07:01:04.844048+0000","last_undegraded":"2024-09-21T07:01:04.844048+0000","last_fullsized":"2024-09-21T07:01:04.844048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.262768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767762+0000","last_change":"2024-09-21T07:01:03.802120+0000","last_active":"2024-09-21T07:01:04.767762+0000","last_peered":"2024-09-21T07:01:04.767762+0000","last_clean":"2024-09-21T07:01:04.767762+0000","last_became_active":"2024-09-21T07:01:03.801699+0000","last_became_peered":"2024-09-21T07:01:03.801699+0000","last_unstale":"2024-09-21T07:01:04.767762+0000","last_undegraded":"2024-09-21T07:01:04.767762+0000","last_fullsized":"2024-09-21T07:01:04.767762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:16.741550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767176+0000","last_change":"2024-09-21T07:01:03.779994+0000","last_active":"2024-09-21T07:01:04.767176+0000","last_peered":"2024-09-21T07:01:04.767176+0000","last_clean":"2024-09-21T07:01:04.767176+0000","last_became_active":"2024-09-21T07:01:03.779267+0000","last_became_peered":"2024-09-21T07:01:03.779267+0000","last_unstale":"2024-09-21T07:01:04.767176+0000","last_undegraded":"2024-09-21T07:01:04.767176+0000","last_fullsized":"2024-09-21T07:01:04.767176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:24.747636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843248+0000","last_change":"2024-09-21T07:01:03.799390+0000","last_active":"2024-09-21T07:01:04.843248+0000","last_peered":"2024-09-21T07:01:04.843248+0000","last_clean":"2024-09-21T07:01:04.843248+0000","last_became_active":"2024-09-21T07:01:03.799078+0000","last_became_peered":"2024-09-21T07:01:03.799078+0000","last_unstale":"2024-09-21T07:01:04.843248+0000","last_undegraded":"2024-09-21T07:01:04.843248+0000","last_fullsized":"2024-09-21T07:01:04.843248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:36.565399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843261+0000","last_change":"2024-09-21T07:01:03.800557+0000","last_active":"2024-09-21T07:01:04.843261+0000","last_peered":"2024-09-21T07:01:04.843261+0000","last_clean":"2024-09-21T07:01:04.843261+0000","last_became_active":"2024-09-21T07:01:03.800262+0000","last_became_peered":"2024-09-21T07:01:03.800262+0000","last_unstale":"2024-09-21T07:01:04.843261+0000","last_undegraded":"2024-09-21T07:01:04.843261+0000","last_fullsized":"2024-09-21T07:01:04.843261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:06.031208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844973+0000","last_change":"2024-09-21T07:01:03.781597+0000","last_active":"2024-09-21T07:01:04.844973+0000","last_peered":"2024-09-21T07:01:04.844973+0000","last_clean":"2024-09-21T07:01:04.844973+0000","last_became_active":"2024-09-21T07:01:03.781303+0000","last_became_peered":"2024-09-21T07:01:03.781303+0000","last_unstale":"2024-09-21T07:01:04.844973+0000","last_undegraded":"2024-09-21T07:01:04.844973+0000","last_fullsized":"2024-09-21T07:01:04.844973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:42.573263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843625+0000","last_change":"2024-09-21T07:01:02.778634+0000","last_active":"2024-09-21T07:01:04.843625+0000","last_peered":"2024-09-21T07:01:04.843625+0000","last_clean":"2024-09-21T07:01:04.843625+0000","last_became_active":"2024-09-21T07:01:02.778310+0000","last_became_peered":"2024-09-21T07:01:02.778310+0000","last_unstale":"2024-09-21T07:01:04.843625+0000","last_undegraded":"2024-09-21T07:01:04.843625+0000","last_fullsized":"2024-09-21T07:01:04.843625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:39.995378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844286+0000","last_change":"2024-09-21T07:01:03.801557+0000","last_active":"2024-09-21T07:01:04.844286+0000","last_peered":"2024-09-21T07:01:04.844286+0000","last_clean":"2024-09-21T07:01:04.844286+0000","last_became_active":"2024-09-21T07:01:03.801233+0000","last_became_peered":"2024-09-21T07:01:03.801233+0000","last_unstale":"2024-09-21T07:01:04.844286+0000","last_undegraded":"2024-09-21T07:01:04.844286+0000","last_fullsized":"2024-09-21T07:01:04.844286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:23:01.557172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.763127+0000","last_change":"2024-09-21T07:01:01.763127+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.763127+0000","last_undegraded":"2024-09-21T07:01:01.763127+0000","last_fullsized":"2024-09-21T07:01:01.763127+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844178+0000","last_change":"2024-09-21T07:01:03.799022+0000","last_active":"2024-09-21T07:01:04.844178+0000","last_peered":"2024-09-21T07:01:04.844178+0000","last_clean":"2024-09-21T07:01:04.844178+0000","last_became_active":"2024-09-21T07:01:03.798589+0000","last_became_peered":"2024-09-21T07:01:03.798589+0000","last_unstale":"2024-09-21T07:01:04.844178+0000","last_undegraded":"2024-09-21T07:01:04.844178+0000","last_fullsized":"2024-09-21T07:01:04.844178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:21.629179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.845030+0000","last_change":"2024-09-21T07:01:02.785856+0000","last_active":"2024-09-21T07:01:04.845030+0000","last_peered":"2024-09-21T07:01:04.845030+0000","last_clean":"2024-09-21T07:01:04.845030+0000","last_became_active":"2024-09-21T07:01:02.785426+0000","last_became_peered":"2024-09-21T07:01:02.785426+0000","last_unstale":"2024-09-21T07:01:04.845030+0000","last_undegraded":"2024-09-21T07:01:04.845030+0000","last_fullsized":"2024-09-21T07:01:04.845030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:21.317089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.762932+0000","last_change":"2024-09-21T07:01:01.762932+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.762932+0000","last_undegraded":"2024-09-21T07:01:01.762932+0000","last_fullsized":"2024-09-21T07:01:01.762932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768173+0000","last_change":"2024-09-21T07:01:03.796538+0000","last_active":"2024-09-21T07:01:04.768173+0000","last_peered":"2024-09-21T07:01:04.768173+0000","last_clean":"2024-09-21T07:01:04.768173+0000","last_became_active":"2024-09-21T07:01:03.796196+0000","last_became_peered":"2024-09-21T07:01:03.796196+0000","last_unstale":"2024-09-21T07:01:04.768173+0000","last_undegraded":"2024-09-21T07:01:04.768173+0000","last_fullsized":"2024-09-21T07:01:04.768173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:33.760115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843918+0000","last_change":"2024-09-21T07:01:02.791472+0000","last_active":"2024-09-21T07:01:04.843918+0000","last_peered":"2024-09-21T07:01:04.843918+0000","last_clean":"2024-09-21T07:01:04.843918+0000","last_became_active":"2024-09-21T07:01:02.791087+0000","last_became_peered":"2024-09-21T07:01:02.791087+0000","last_unstale":"2024-09-21T07:01:04.843918+0000","last_undegraded":"2024-09-21T07:01:04.843918+0000","last_fullsized":"2024-09-21T07:01:04.843918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:37.195545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843171+0000","last_change":"2024-09-21T07:01:03.800189+0000","last_active":"2024-09-21T07:01:04.843171+0000","last_peered":"2024-09-21T07:01:04.843171+0000","last_clean":"2024-09-21T07:01:04.843171+0000","last_became_active":"2024-09-21T07:01:03.799901+0000","last_became_peered":"2024-09-21T07:01:03.799901+0000","last_unstale":"2024-09-21T07:01:04.843171+0000","last_undegraded":"2024-09-21T07:01:04.843171+0000","last_fullsized":"2024-09-21T07:01:04.843171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:58.610632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843353+0000","last_change":"2024-09-21T07:01:02.786240+0000","last_active":"2024-09-21T07:01:04.843353+0000","last_peered":"2024-09-21T07:01:04.843353+0000","last_clean":"2024-09-21T07:01:04.843353+0000","last_became_active":"2024-09-21T07:01:02.785829+0000","last_became_peered":"2024-09-21T07:01:02.785829+0000","last_unstale":"2024-09-21T07:01:04.843353+0000","last_undegraded":"2024-09-21T07:01:04.843353+0000","last_fullsized":"2024-09-21T07:01:04.843353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:52.905472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768169+0000","last_change":"2024-09-21T07:01:03.790770+0000","last_active":"2024-09-21T07:01:04.768169+0000","last_peered":"2024-09-21T07:01:04.768169+0000","last_clean":"2024-09-21T07:01:04.768169+0000","last_became_active":"2024-09-21T07:01:03.790466+0000","last_became_peered":"2024-09-21T07:01:03.790466+0000","last_unstale":"2024-09-21T07:01:04.768169+0000","last_undegraded":"2024-09-21T07:01:04.768169+0000","last_fullsized":"2024-09-21T07:01:04.768169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:39.192000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843624+0000","last_change":"2024-09-21T07:01:02.777473+0000","last_active":"2024-09-21T07:01:04.843624+0000","last_peered":"2024-09-21T07:01:04.843624+0000","last_clean":"2024-09-21T07:01:04.843624+0000","last_became_active":"2024-09-21T07:01:02.777116+0000","last_became_peered":"2024-09-21T07:01:02.777116+0000","last_unstale":"2024-09-21T07:01:04.843624+0000","last_undegraded":"2024-09-21T07:01:04.843624+0000","last_fullsized":"2024-09-21T07:01:04.843624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:59:40.790513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843506+0000","last_change":"2024-09-21T07:01:02.783052+0000","last_active":"2024-09-21T07:01:04.843506+0000","last_peered":"2024-09-21T07:01:04.843506+0000","last_clean":"2024-09-21T07:01:04.843506+0000","last_became_active":"2024-09-21T07:01:02.782729+0000","last_became_peered":"2024-09-21T07:01:02.782729+0000","last_unstale":"2024-09-21T07:01:04.843506+0000","last_undegraded":"2024-09-21T07:01:04.843506+0000","last_fullsized":"2024-09-21T07:01:04.843506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.976446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844084+0000","last_change":"2024-09-21T07:01:03.772763+0000","last_active":"2024-09-21T07:01:04.844084+0000","last_peered":"2024-09-21T07:01:04.844084+0000","last_clean":"2024-09-21T07:01:04.844084+0000","last_became_active":"2024-09-21T07:01:03.772413+0000","last_became_peered":"2024-09-21T07:01:03.772413+0000","last_unstale":"2024-09-21T07:01:04.844084+0000","last_undegraded":"2024-09-21T07:01:04.844084+0000","last_fullsized":"2024-09-21T07:01:04.844084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:04.294355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844234+0000","last_change":"2024-09-21T07:01:02.780860+0000","last_active":"2024-09-21T07:01:04.844234+0000","last_peered":"2024-09-21T07:01:04.844234+0000","last_clean":"2024-09-21T07:01:04.844234+0000","last_became_active":"2024-09-21T07:01:02.780296+0000","last_became_peered":"2024-09-21T07:01:02.780296+0000","last_unstale":"2024-09-21T07:01:04.844234+0000","last_undegraded":"2024-09-21T07:01:04.844234+0000","last_fullsized":"2024-09-21T07:01:04.844234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:36.181080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844702+0000","last_change":"2024-09-21T07:01:02.781901+0000","last_active":"2024-09-21T07:01:04.844702+0000","last_peered":"2024-09-21T07:01:04.844702+0000","last_clean":"2024-09-21T07:01:04.844702+0000","last_became_active":"2024-09-21T07:01:02.781563+0000","last_became_peered":"2024-09-21T07:01:02.781563+0000","last_unstale":"2024-09-21T07:01:04.844702+0000","last_undegraded":"2024-09-21T07:01:04.844702+0000","last_fullsized":"2024-09-21T07:01:04.844702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:20.713409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843954+0000","last_change":"2024-09-21T07:01:02.782653+0000","last_active":"2024-09-21T07:01:04.843954+0000","last_peered":"2024-09-21T07:01:04.843954+0000","last_clean":"2024-09-21T07:01:04.843954+0000","last_became_active":"2024-09-21T07:01:02.782261+0000","last_became_peered":"2024-09-21T07:01:02.782261+0000","last_unstale":"2024-09-21T07:01:04.843954+0000","last_undegraded":"2024-09-21T07:01:04.843954+0000","last_fullsized":"2024-09-21T07:01:04.843954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:15.736038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843335+0000","last_change":"2024-09-21T07:01:03.796498+0000","last_active":"2024-09-21T07:01:04.843335+0000","last_peered":"2024-09-21T07:01:04.843335+0000","last_clean":"2024-09-21T07:01:04.843335+0000","last_became_active":"2024-09-21T07:01:03.796169+0000","last_became_peered":"2024-09-21T07:01:03.796169+0000","last_unstale":"2024-09-21T07:01:04.843335+0000","last_undegraded":"2024-09-21T07:01:04.843335+0000","last_fullsized":"2024-09-21T07:01:04.843335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:50.551965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844229+0000","last_change":"2024-09-21T07:01:02.775824+0000","last_active":"2024-09-21T07:01:04.844229+0000","last_peered":"2024-09-21T07:01:04.844229+0000","last_clean":"2024-09-21T07:01:04.844229+0000","last_became_active":"2024-09-21T07:01:02.775228+0000","last_became_peered":"2024-09-21T07:01:02.775228+0000","last_unstale":"2024-09-21T07:01:04.844229+0000","last_undegraded":"2024-09-21T07:01:04.844229+0000","last_fullsized":"2024-09-21T07:01:04.844229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:37.195545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843771+0000","last_change":"2024-09-21T07:01:03.780446+0000","last_active":"2024-09-21T07:01:04.843771+0000","last_peered":"2024-09-21T07:01:04.843771+0000","last_clean":"2024-09-21T07:01:04.843771+0000","last_became_active":"2024-09-21T07:01:03.780180+0000","last_became_peered":"2024-09-21T07:01:03.780180+0000","last_unstale":"2024-09-21T07:01:04.843771+0000","last_undegraded":"2024-09-21T07:01:04.843771+0000","last_fullsized":"2024-09-21T07:01:04.843771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:57.734540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844036+0000","last_change":"2024-09-21T07:01:02.783777+0000","last_active":"2024-09-21T07:01:04.844036+0000","last_peered":"2024-09-21T07:01:04.844036+0000","last_clean":"2024-09-21T07:01:04.844036+0000","last_became_active":"2024-09-21T07:01:02.783438+0000","last_became_peered":"2024-09-21T07:01:02.783438+0000","last_unstale":"2024-09-21T07:01:04.844036+0000","last_undegraded":"2024-09-21T07:01:04.844036+0000","last_fullsized":"2024-09-21T07:01:04.844036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:44.480439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.762490+0000","last_change":"2024-09-21T07:01:01.762490+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.762490+0000","last_undegraded":"2024-09-21T07:01:01.762490+0000","last_fullsized":"2024-09-21T07:01:01.762490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843383+0000","last_change":"2024-09-21T07:01:03.798215+0000","last_active":"2024-09-21T07:01:04.843383+0000","last_peered":"2024-09-21T07:01:04.843383+0000","last_clean":"2024-09-21T07:01:04.843383+0000","last_became_active":"2024-09-21T07:01:03.796516+0000","last_became_peered":"2024-09-21T07:01:03.796516+0000","last_unstale":"2024-09-21T07:01:04.843383+0000","last_undegraded":"2024-09-21T07:01:04.843383+0000","last_fullsized":"2024-09-21T07:01:04.843383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:28.466335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.763414+0000","last_change":"2024-09-21T07:01:01.763414+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.763414+0000","last_undegraded":"2024-09-21T07:01:01.763414+0000","last_fullsized":"2024-09-21T07:01:01.763414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843741+0000","last_change":"2024-09-21T07:01:03.791099+0000","last_active":"2024-09-21T07:01:04.843741+0000","last_peered":"2024-09-21T07:01:04.843741+0000","last_clean":"2024-09-21T07:01:04.843741+0000","last_became_active":"2024-09-21T07:01:03.790772+0000","last_became_peered":"2024-09-21T07:01:03.790772+0000","last_unstale":"2024-09-21T07:01:04.843741+0000","last_undegraded":"2024-09-21T07:01:04.843741+0000","last_fullsized":"2024-09-21T07:01:04.843741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:33.139496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843700+0000","last_change":"2024-09-21T07:01:02.782460+0000","last_active":"2024-09-21T07:01:04.843700+0000","last_peered":"2024-09-21T07:01:04.843700+0000","last_clean":"2024-09-21T07:01:04.843700+0000","last_became_active":"2024-09-21T07:01:02.782160+0000","last_became_peered":"2024-09-21T07:01:02.782160+0000","last_unstale":"2024-09-21T07:01:04.843700+0000","last_undegraded":"2024-09-21T07:01:04.843700+0000","last_fullsized":"2024-09-21T07:01:04.843700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:24.532930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844055+0000","last_change":"2024-09-21T07:01:03.789639+0000","last_active":"2024-09-21T07:01:04.844055+0000","last_peered":"2024-09-21T07:01:04.844055+0000","last_clean":"2024-09-21T07:01:04.844055+0000","last_became_active":"2024-09-21T07:01:03.789329+0000","last_became_peered":"2024-09-21T07:01:03.789329+0000","last_unstale":"2024-09-21T07:01:04.844055+0000","last_undegraded":"2024-09-21T07:01:04.844055+0000","last_fullsized":"2024-09-21T07:01:04.844055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:28.686912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843894+0000","last_change":"2024-09-21T07:01:02.780877+0000","last_active":"2024-09-21T07:01:04.843894+0000","last_peered":"2024-09-21T07:01:04.843894+0000","last_clean":"2024-09-21T07:01:04.843894+0000","last_became_active":"2024-09-21T07:01:02.780530+0000","last_became_peered":"2024-09-21T07:01:02.780530+0000","last_unstale":"2024-09-21T07:01:04.843894+0000","last_undegraded":"2024-09-21T07:01:04.843894+0000","last_fullsized":"2024-09-21T07:01:04.843894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:28.933785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768917+0000","last_change":"2024-09-21T07:01:03.790197+0000","last_active":"2024-09-21T07:01:04.768917+0000","last_peered":"2024-09-21T07:01:04.768917+0000","last_clean":"2024-09-21T07:01:04.768917+0000","last_became_active":"2024-09-21T07:01:03.789769+0000","last_became_peered":"2024-09-21T07:01:03.789769+0000","last_unstale":"2024-09-21T07:01:04.768917+0000","last_undegraded":"2024-09-21T07:01:04.768917+0000","last_fullsized":"2024-09-21T07:01:04.768917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:32.176127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844415+0000","last_change":"2024-09-21T07:01:02.792339+0000","last_active":"2024-09-21T07:01:04.844415+0000","last_peered":"2024-09-21T07:01:04.844415+0000","last_clean":"2024-09-21T07:01:04.844415+0000","last_became_active":"2024-09-21T07:01:02.791971+0000","last_became_peered":"2024-09-21T07:01:02.791971+0000","last_unstale":"2024-09-21T07:01:04.844415+0000","last_undegraded":"2024-09-21T07:01:04.844415+0000","last_fullsized":"2024-09-21T07:01:04.844415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:43.713520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844168+0000","last_change":"2024-09-21T07:01:03.782318+0000","last_active":"2024-09-21T07:01:04.844168+0000","last_peered":"2024-09-21T07:01:04.844168+0000","last_clean":"2024-09-21T07:01:04.844168+0000","last_became_active":"2024-09-21T07:01:03.781942+0000","last_became_peered":"2024-09-21T07:01:03.781942+0000","last_unstale":"2024-09-21T07:01:04.844168+0000","last_undegraded":"2024-09-21T07:01:04.844168+0000","last_fullsized":"2024-09-21T07:01:04.844168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:34.894160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843829+0000","last_change":"2024-09-21T07:01:02.779001+0000","last_active":"2024-09-21T07:01:04.843829+0000","last_peered":"2024-09-21T07:01:04.843829+0000","last_clean":"2024-09-21T07:01:04.843829+0000","last_became_active":"2024-09-21T07:01:02.778522+0000","last_became_peered":"2024-09-21T07:01:02.778522+0000","last_unstale":"2024-09-21T07:01:04.843829+0000","last_undegraded":"2024-09-21T07:01:04.843829+0000","last_fullsized":"2024-09-21T07:01:04.843829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:03.188520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844992+0000","last_change":"2024-09-21T07:01:03.790572+0000","last_active":"2024-09-21T07:01:04.844992+0000","last_peered":"2024-09-21T07:01:04.844992+0000","last_clean":"2024-09-21T07:01:04.844992+0000","last_became_active":"2024-09-21T07:01:03.790070+0000","last_became_peered":"2024-09-21T07:01:03.790070+0000","last_unstale":"2024-09-21T07:01:04.844992+0000","last_undegraded":"2024-09-21T07:01:04.844992+0000","last_fullsized":"2024-09-21T07:01:04.844992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:40.124786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767672+0000","last_change":"2024-09-21T07:01:02.778072+0000","last_active":"2024-09-21T07:01:04.767672+0000","last_peered":"2024-09-21T07:01:04.767672+0000","last_clean":"2024-09-21T07:01:04.767672+0000","last_became_active":"2024-09-21T07:01:02.777714+0000","last_became_peered":"2024-09-21T07:01:02.777714+0000","last_unstale":"2024-09-21T07:01:04.767672+0000","last_undegraded":"2024-09-21T07:01:04.767672+0000","last_fullsized":"2024-09-21T07:01:04.767672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:05.574202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844019+0000","last_change":"2024-09-21T07:01:03.792264+0000","last_active":"2024-09-21T07:01:04.844019+0000","last_peered":"2024-09-21T07:01:04.844019+0000","last_clean":"2024-09-21T07:01:04.844019+0000","last_became_active":"2024-09-21T07:01:03.791787+0000","last_became_peered":"2024-09-21T07:01:03.791787+0000","last_unstale":"2024-09-21T07:01:04.844019+0000","last_undegraded":"2024-09-21T07:01:04.844019+0000","last_fullsized":"2024-09-21T07:01:04.844019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843915+0000","last_change":"2024-09-21T07:01:02.778713+0000","last_active":"2024-09-21T07:01:04.843915+0000","last_peered":"2024-09-21T07:01:04.843915+0000","last_clean":"2024-09-21T07:01:04.843915+0000","last_became_active":"2024-09-21T07:01:02.778375+0000","last_became_peered":"2024-09-21T07:01:02.778375+0000","last_unstale":"2024-09-21T07:01:04.843915+0000","last_undegraded":"2024-09-21T07:01:04.843915+0000","last_fullsized":"2024-09-21T07:01:04.843915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:41.462449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843779+0000","last_change":"2024-09-21T07:01:03.777959+0000","last_active":"2024-09-21T07:01:04.843779+0000","last_peered":"2024-09-21T07:01:04.843779+0000","last_clean":"2024-09-21T07:01:04.843779+0000","last_became_active":"2024-09-21T07:01:03.777648+0000","last_became_peered":"2024-09-21T07:01:03.777648+0000","last_unstale":"2024-09-21T07:01:04.843779+0000","last_undegraded":"2024-09-21T07:01:04.843779+0000","last_fullsized":"2024-09-21T07:01:04.843779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:11.993232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843470+0000","last_change":"2024-09-21T07:01:02.792375+0000","last_active":"2024-09-21T07:01:04.843470+0000","last_peered":"2024-09-21T07:01:04.843470+0000","last_clean":"2024-09-21T07:01:04.843470+0000","last_became_active":"2024-09-21T07:01:02.792035+0000","last_became_peered":"2024-09-21T07:01:02.792035+0000","last_unstale":"2024-09-21T07:01:04.843470+0000","last_undegraded":"2024-09-21T07:01:04.843470+0000","last_fullsized":"2024-09-21T07:01:04.843470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:38.186488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843785+0000","last_change":"2024-09-21T07:01:03.788441+0000","last_active":"2024-09-21T07:01:04.843785+0000","last_peered":"2024-09-21T07:01:04.843785+0000","last_clean":"2024-09-21T07:01:04.843785+0000","last_became_active":"2024-09-21T07:01:03.788130+0000","last_became_peered":"2024-09-21T07:01:03.788130+0000","last_unstale":"2024-09-21T07:01:04.843785+0000","last_undegraded":"2024-09-21T07:01:04.843785+0000","last_fullsized":"2024-09-21T07:01:04.843785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:13.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768417+0000","last_change":"2024-09-21T07:01:02.776793+0000","last_active":"2024-09-21T07:01:04.768417+0000","last_peered":"2024-09-21T07:01:04.768417+0000","last_clean":"2024-09-21T07:01:04.768417+0000","last_became_active":"2024-09-21T07:01:02.775460+0000","last_became_peered":"2024-09-21T07:01:02.775460+0000","last_unstale":"2024-09-21T07:01:04.768417+0000","last_undegraded":"2024-09-21T07:01:04.768417+0000","last_fullsized":"2024-09-21T07:01:04.768417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:05.467271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768307+0000","last_change":"2024-09-21T07:01:03.791274+0000","last_active":"2024-09-21T07:01:04.768307+0000","last_peered":"2024-09-21T07:01:04.768307+0000","last_clean":"2024-09-21T07:01:04.768307+0000","last_became_active":"2024-09-21T07:01:03.790995+0000","last_became_peered":"2024-09-21T07:01:03.790995+0000","last_unstale":"2024-09-21T07:01:04.768307+0000","last_undegraded":"2024-09-21T07:01:04.768307+0000","last_fullsized":"2024-09-21T07:01:04.768307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:52.515976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843395+0000","last_change":"2024-09-21T07:01:02.781006+0000","last_active":"2024-09-21T07:01:04.843395+0000","last_peered":"2024-09-21T07:01:04.843395+0000","last_clean":"2024-09-21T07:01:04.843395+0000","last_became_active":"2024-09-21T07:01:02.780061+0000","last_became_peered":"2024-09-21T07:01:02.780061+0000","last_unstale":"2024-09-21T07:01:04.843395+0000","last_undegraded":"2024-09-21T07:01:04.843395+0000","last_fullsized":"2024-09-21T07:01:04.843395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:26.121246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844799+0000","last_change":"2024-09-21T07:01:03.790603+0000","last_active":"2024-09-21T07:01:04.844799+0000","last_peered":"2024-09-21T07:01:04.844799+0000","last_clean":"2024-09-21T07:01:04.844799+0000","last_became_active":"2024-09-21T07:01:03.790244+0000","last_became_peered":"2024-09-21T07:01:03.790244+0000","last_unstale":"2024-09-21T07:01:04.844799+0000","last_undegraded":"2024-09-21T07:01:04.844799+0000","last_fullsized":"2024-09-21T07:01:04.844799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:07.386079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843927+0000","last_change":"2024-09-21T07:01:02.790264+0000","last_active":"2024-09-21T07:01:04.843927+0000","last_peered":"2024-09-21T07:01:04.843927+0000","last_clean":"2024-09-21T07:01:04.843927+0000","last_became_active":"2024-09-21T07:01:02.789872+0000","last_became_peered":"2024-09-21T07:01:02.789872+0000","last_unstale":"2024-09-21T07:01:04.843927+0000","last_undegraded":"2024-09-21T07:01:04.843927+0000","last_fullsized":"2024-09-21T07:01:04.843927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.976446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843758+0000","last_change":"2024-09-21T07:01:03.781029+0000","last_active":"2024-09-21T07:01:04.843758+0000","last_peered":"2024-09-21T07:01:04.843758+0000","last_clean":"2024-09-21T07:01:04.843758+0000","last_became_active":"2024-09-21T07:01:03.780695+0000","last_became_peered":"2024-09-21T07:01:03.780695+0000","last_unstale":"2024-09-21T07:01:04.843758+0000","last_undegraded":"2024-09-21T07:01:04.843758+0000","last_fullsized":"2024-09-21T07:01:04.843758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:24.208627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844717+0000","last_change":"2024-09-21T07:01:02.781328+0000","last_active":"2024-09-21T07:01:04.844717+0000","last_peered":"2024-09-21T07:01:04.844717+0000","last_clean":"2024-09-21T07:01:04.844717+0000","last_became_active":"2024-09-21T07:01:02.780299+0000","last_became_peered":"2024-09-21T07:01:02.780299+0000","last_unstale":"2024-09-21T07:01:04.844717+0000","last_undegraded":"2024-09-21T07:01:04.844717+0000","last_fullsized":"2024-09-21T07:01:04.844717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:56.729028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844953+0000","last_change":"2024-09-21T07:01:03.795504+0000","last_active":"2024-09-21T07:01:04.844953+0000","last_peered":"2024-09-21T07:01:04.844953+0000","last_clean":"2024-09-21T07:01:04.844953+0000","last_became_active":"2024-09-21T07:01:03.795137+0000","last_became_peered":"2024-09-21T07:01:03.795137+0000","last_unstale":"2024-09-21T07:01:04.844953+0000","last_undegraded":"2024-09-21T07:01:04.844953+0000","last_fullsized":"2024-09-21T07:01:04.844953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:35.892752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844355+0000","last_change":"2024-09-21T07:01:02.778586+0000","last_active":"2024-09-21T07:01:04.844355+0000","last_peered":"2024-09-21T07:01:04.844355+0000","last_clean":"2024-09-21T07:01:04.844355+0000","last_became_active":"2024-09-21T07:01:02.778221+0000","last_became_peered":"2024-09-21T07:01:02.778221+0000","last_unstale":"2024-09-21T07:01:04.844355+0000","last_undegraded":"2024-09-21T07:01:04.844355+0000","last_fullsized":"2024-09-21T07:01:04.844355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:31.170615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767423+0000","last_change":"2024-09-21T07:01:03.779595+0000","last_active":"2024-09-21T07:01:04.767423+0000","last_peered":"2024-09-21T07:01:04.767423+0000","last_clean":"2024-09-21T07:01:04.767423+0000","last_became_active":"2024-09-21T07:01:03.778855+0000","last_became_peered":"2024-09-21T07:01:03.778855+0000","last_unstale":"2024-09-21T07:01:04.767423+0000","last_undegraded":"2024-09-21T07:01:04.767423+0000","last_fullsized":"2024-09-21T07:01:04.767423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:43.811241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844675+0000","last_change":"2024-09-21T07:01:02.790214+0000","last_active":"2024-09-21T07:01:04.844675+0000","last_peered":"2024-09-21T07:01:04.844675+0000","last_clean":"2024-09-21T07:01:04.844675+0000","last_became_active":"2024-09-21T07:01:02.789887+0000","last_became_peered":"2024-09-21T07:01:02.789887+0000","last_unstale":"2024-09-21T07:01:04.844675+0000","last_undegraded":"2024-09-21T07:01:04.844675+0000","last_fullsized":"2024-09-21T07:01:04.844675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:51.510464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844153+0000","last_change":"2024-09-21T07:01:02.777740+0000","last_active":"2024-09-21T07:01:04.844153+0000","last_peered":"2024-09-21T07:01:04.844153+0000","last_clean":"2024-09-21T07:01:04.844153+0000","last_became_active":"2024-09-21T07:01:02.777294+0000","last_became_peered":"2024-09-21T07:01:02.777294+0000","last_unstale":"2024-09-21T07:01:04.844153+0000","last_undegraded":"2024-09-21T07:01:04.844153+0000","last_fullsized":"2024-09-21T07:01:04.844153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:44.480439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T07:01:02.756158+0000","last_change":"2024-09-21T07:01:02.756158+0000","last_active":"2024-09-21T07:01:02.756158+0000","last_peered":"2024-09-21T07:01:02.756158+0000","last_clean":"2024-09-21T07:01:02.756158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:02.756158+0000","last_undegraded":"2024-09-21T07:01:02.756158+0000","last_fullsized":"2024-09-21T07:01:02.756158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843373+0000","last_change":"2024-09-21T07:01:02.792247+0000","last_active":"2024-09-21T07:01:04.843373+0000","last_peered":"2024-09-21T07:01:04.843373+0000","last_clean":"2024-09-21T07:01:04.843373+0000","last_became_active":"2024-09-21T07:01:02.791859+0000","last_became_peered":"2024-09-21T07:01:02.791859+0000","last_unstale":"2024-09-21T07:01:04.843373+0000","last_undegraded":"2024-09-21T07:01:04.843373+0000","last_fullsized":"2024-09-21T07:01:04.843373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:51.510464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843787+0000","last_change":"2024-09-21T07:01:03.782839+0000","last_active":"2024-09-21T07:01:04.843787+0000","last_peered":"2024-09-21T07:01:04.843787+0000","last_clean":"2024-09-21T07:01:04.843787+0000","last_became_active":"2024-09-21T07:01:03.782446+0000","last_became_peered":"2024-09-21T07:01:03.782446+0000","last_unstale":"2024-09-21T07:01:04.843787+0000","last_undegraded":"2024-09-21T07:01:04.843787+0000","last_fullsized":"2024-09-21T07:01:04.843787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:29.430348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-09-21T07:01:01.762492+0000","last_change":"2024-09-21T07:01:01.762492+0000","last_active":"2024-09-21T07:01:01.750646+0000","last_peered":"2024-09-21T07:01:01.750646+0000","last_clean":"2024-09-21T07:01:01.750646+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T07:01:01.762492+0000","last_undegraded":"2024-09-21T07:01:01.762492+0000","last_fullsized":"2024-09-21T07:01:01.762492+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767690+0000","last_change":"2024-09-21T07:01:03.788278+0000","last_active":"2024-09-21T07:01:04.767690+0000","last_peered":"2024-09-21T07:01:04.767690+0000","last_clean":"2024-09-21T07:01:04.767690+0000","last_became_active":"2024-09-21T07:01:03.787728+0000","last_became_peered":"2024-09-21T07:01:03.787728+0000","last_unstale":"2024-09-21T07:01:04.767690+0000","last_undegraded":"2024-09-21T07:01:04.767690+0000","last_fullsized":"2024-09-21T07:01:04.767690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:04.194032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843977+0000","last_change":"2024-09-21T07:01:02.779208+0000","last_active":"2024-09-21T07:01:04.843977+0000","last_peered":"2024-09-21T07:01:04.843977+0000","last_clean":"2024-09-21T07:01:04.843977+0000","last_became_active":"2024-09-21T07:01:02.778011+0000","last_became_peered":"2024-09-21T07:01:02.778011+0000","last_unstale":"2024-09-21T07:01:04.843977+0000","last_undegraded":"2024-09-21T07:01:04.843977+0000","last_fullsized":"2024-09-21T07:01:04.843977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:04.375217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767896+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:01:04.767896+0000","last_peered":"2024-09-21T07:01:04.767896+0000","last_clean":"2024-09-21T07:01:04.767896+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:01:04.767896+0000","last_undegraded":"2024-09-21T07:01:04.767896+0000","last_fullsized":"2024-09-21T07:01:04.767896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":133486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,11],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":364544,"data_stored":135076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":730714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":134240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":133498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":730202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":133554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:01:08.595 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-21T07:01:08.595 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:01:02.756158+0000', 'last_change': '2024-09-21T07:01:02.756158+0000', 'last_active': '2024-09-21T07:01:02.756158+0000', 'last_peered': '2024-09-21T07:01:02.756158+0000', 'last_clean': '2024-09-21T07:01:02.756158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:02.756158+0000', 'last_undegraded': '2024-09-21T07:01:02.756158+0000', 'last_fullsized': '2024-09-21T07:01:02.756158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:01:08.595 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-21T07:01:08.595 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:01:02.756158+0000', 'last_change': '2024-09-21T07:01:02.756158+0000', 'last_active': '2024-09-21T07:01:02.756158+0000', 'last_peered': '2024-09-21T07:01:02.756158+0000', 'last_clean': '2024-09-21T07:01:02.756158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:02.756158+0000', 'last_undegraded': '2024-09-21T07:01:02.756158+0000', 'last_fullsized': '2024-09-21T07:01:02.756158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:01:08.595 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-21T07:01:08.595 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:01:02.756158+0000', 'last_change': '2024-09-21T07:01:02.756158+0000', 'last_active': '2024-09-21T07:01:02.756158+0000', 'last_peered': '2024-09-21T07:01:02.756158+0000', 'last_clean': '2024-09-21T07:01:02.756158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:02.756158+0000', 'last_undegraded': '2024-09-21T07:01:02.756158+0000', 'last_fullsized': '2024-09-21T07:01:02.756158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:01:08.595 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-21T07:01:08.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:01:02.756158+0000', 'last_change': '2024-09-21T07:01:02.756158+0000', 'last_active': '2024-09-21T07:01:02.756158+0000', 'last_peered': '2024-09-21T07:01:02.756158+0000', 'last_clean': '2024-09-21T07:01:02.756158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:02.756158+0000', 'last_undegraded': '2024-09-21T07:01:02.756158+0000', 'last_fullsized': '2024-09-21T07:01:02.756158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:01:08.596 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-21T07:01:08.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:01:02.756158+0000', 'last_change': '2024-09-21T07:01:02.756158+0000', 'last_active': '2024-09-21T07:01:02.756158+0000', 'last_peered': '2024-09-21T07:01:02.756158+0000', 'last_clean': '2024-09-21T07:01:02.756158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:02.756158+0000', 'last_undegraded': '2024-09-21T07:01:02.756158+0000', 'last_fullsized': '2024-09-21T07:01:02.756158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:01:08.596 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-21T07:01:08.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:01:01.763127+0000', 'last_change': '2024-09-21T07:01:01.763127+0000', 'last_active': '2024-09-21T07:01:01.750646+0000', 'last_peered': '2024-09-21T07:01:01.750646+0000', 'last_clean': '2024-09-21T07:01:01.750646+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:01.763127+0000', 'last_undegraded': '2024-09-21T07:01:01.763127+0000', 'last_fullsized': '2024-09-21T07:01:01.763127+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:01:08.596 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-21T07:01:08.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:01:02.756158+0000', 'last_change': '2024-09-21T07:01:02.756158+0000', 'last_active': '2024-09-21T07:01:02.756158+0000', 'last_peered': '2024-09-21T07:01:02.756158+0000', 'last_clean': '2024-09-21T07:01:02.756158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:02.756158+0000', 'last_undegraded': '2024-09-21T07:01:02.756158+0000', 'last_fullsized': '2024-09-21T07:01:02.756158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:01:08.596 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-21T07:01:08.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:01:01.762932+0000', 'last_change': '2024-09-21T07:01:01.762932+0000', 'last_active': '2024-09-21T07:01:01.750646+0000', 'last_peered': '2024-09-21T07:01:01.750646+0000', 'last_clean': '2024-09-21T07:01:01.750646+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:01.762932+0000', 'last_undegraded': '2024-09-21T07:01:01.762932+0000', 'last_fullsized': '2024-09-21T07:01:01.762932+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:01:08.596 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-21T07:01:08.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:01:02.756158+0000', 'last_change': '2024-09-21T07:01:02.756158+0000', 'last_active': '2024-09-21T07:01:02.756158+0000', 'last_peered': '2024-09-21T07:01:02.756158+0000', 'last_clean': '2024-09-21T07:01:02.756158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:02.756158+0000', 'last_undegraded': '2024-09-21T07:01:02.756158+0000', 'last_fullsized': '2024-09-21T07:01:02.756158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:01:08.597 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-21T07:01:08.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:01:02.756158+0000', 'last_change': '2024-09-21T07:01:02.756158+0000', 'last_active': '2024-09-21T07:01:02.756158+0000', 'last_peered': '2024-09-21T07:01:02.756158+0000', 'last_clean': '2024-09-21T07:01:02.756158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:02.756158+0000', 'last_undegraded': '2024-09-21T07:01:02.756158+0000', 'last_fullsized': '2024-09-21T07:01:02.756158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:01:08.597 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-21T07:01:08.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:01:02.756158+0000', 'last_change': '2024-09-21T07:01:02.756158+0000', 'last_active': '2024-09-21T07:01:02.756158+0000', 'last_peered': '2024-09-21T07:01:02.756158+0000', 'last_clean': '2024-09-21T07:01:02.756158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:02.756158+0000', 'last_undegraded': '2024-09-21T07:01:02.756158+0000', 'last_fullsized': '2024-09-21T07:01:02.756158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:01:08.597 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-21T07:01:08.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:01:02.756158+0000', 'last_change': '2024-09-21T07:01:02.756158+0000', 'last_active': '2024-09-21T07:01:02.756158+0000', 'last_peered': '2024-09-21T07:01:02.756158+0000', 'last_clean': '2024-09-21T07:01:02.756158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:02.756158+0000', 'last_undegraded': '2024-09-21T07:01:02.756158+0000', 'last_fullsized': '2024-09-21T07:01:02.756158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:01:08.597 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-21T07:01:08.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:01:01.762490+0000', 'last_change': '2024-09-21T07:01:01.762490+0000', 'last_active': '2024-09-21T07:01:01.750646+0000', 'last_peered': '2024-09-21T07:01:01.750646+0000', 'last_clean': '2024-09-21T07:01:01.750646+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:01.762490+0000', 'last_undegraded': '2024-09-21T07:01:01.762490+0000', 'last_fullsized': '2024-09-21T07:01:01.762490+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:01:08.597 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-09-21T07:01:08.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:01:01.763414+0000', 'last_change': '2024-09-21T07:01:01.763414+0000', 'last_active': '2024-09-21T07:01:01.750646+0000', 'last_peered': '2024-09-21T07:01:01.750646+0000', 'last_clean': '2024-09-21T07:01:01.750646+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:01.763414+0000', 'last_undegraded': '2024-09-21T07:01:01.763414+0000', 'last_fullsized': '2024-09-21T07:01:01.763414+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:01:08.597 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-21T07:01:08.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:01:02.756158+0000', 'last_change': '2024-09-21T07:01:02.756158+0000', 'last_active': '2024-09-21T07:01:02.756158+0000', 'last_peered': '2024-09-21T07:01:02.756158+0000', 'last_clean': '2024-09-21T07:01:02.756158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:02.756158+0000', 'last_undegraded': '2024-09-21T07:01:02.756158+0000', 'last_fullsized': '2024-09-21T07:01:02.756158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:01:08.598 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-21T07:01:08.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-21T07:01:02.756158+0000', 'last_change': '2024-09-21T07:01:02.756158+0000', 'last_active': '2024-09-21T07:01:02.756158+0000', 'last_peered': '2024-09-21T07:01:02.756158+0000', 'last_clean': '2024-09-21T07:01:02.756158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:02.756158+0000', 'last_undegraded': '2024-09-21T07:01:02.756158+0000', 'last_fullsized': '2024-09-21T07:01:02.756158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:02.756158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-21T07:01:08.598 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-09-21T07:01:08.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-09-21T07:01:01.762492+0000', 'last_change': '2024-09-21T07:01:01.762492+0000', 'last_active': '2024-09-21T07:01:01.750646+0000', 'last_peered': '2024-09-21T07:01:01.750646+0000', 'last_clean': '2024-09-21T07:01:01.750646+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-21T07:01:01.762492+0000', 'last_undegraded': '2024-09-21T07:01:01.762492+0000', 'last_fullsized': '2024-09-21T07:01:01.762492+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'last_clean_scrub_stamp': '2024-09-21T07:01:01.750646+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-21T07:01:08.598 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T07:01:08.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.744+0000 7f33ed7ba640 1 -- 172.21.15.63:0/4000028037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33e815ef00 msgr2=0x7f33e80d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.744+0000 7f33ed7ba640 1 --2- 172.21.15.63:0/4000028037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33e815ef00 0x7f33e80d2c40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009830 tx=0x7f33dc02a510 comp rx=0 tx=0).stop 2024-09-21T07:01:08.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.744+0000 7f33ed7ba640 1 -- 172.21.15.63:0/4000028037 shutdown_connections 2024-09-21T07:01:08.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.744+0000 7f33ed7ba640 1 --2- 172.21.15.63:0/4000028037 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f33e80cf310 0x7f33e80cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.744+0000 7f33ed7ba640 1 --2- 172.21.15.63:0/4000028037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33e815ef00 0x7f33e80d2c40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.744+0000 7f33ed7ba640 1 -- 172.21.15.63:0/4000028037 >> 172.21.15.63:0/4000028037 conn(0x7f33e808bfd0 msgr2=0x7f33e80d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:08.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.745+0000 7f33ed7ba640 1 -- 172.21.15.63:0/4000028037 shutdown_connections 2024-09-21T07:01:08.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.745+0000 7f33ed7ba640 1 -- 172.21.15.63:0/4000028037 wait complete. 2024-09-21T07:01:08.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.746+0000 7f33ed7ba640 1 Processor -- start 2024-09-21T07:01:08.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.747+0000 7f33ed7ba640 1 -- start start 2024-09-21T07:01:08.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33ed7ba640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33e80b7530 0x7f33e80c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33ed7ba640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f33e80cf310 0x7f33e815a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33ed7ba640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33e815ef00 0x7f33e80c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33ed7ba640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f33e80cfff0 con 0x7f33e815ef00 2024-09-21T07:01:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33ed7ba640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f33e80cfe70 con 0x7f33e80b7530 2024-09-21T07:01:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33ed7ba640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f33e80d0170 con 0x7f33e80cf310 2024-09-21T07:01:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33e77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33e815ef00 0x7f33e80c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33e77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33e815ef00 0x7f33e80c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51458/0 (socket says 172.21.15.63:51458) 2024-09-21T07:01:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33e77fe640 1 -- 172.21.15.63:0/1426208326 learned_addr learned my addr 172.21.15.63:0/1426208326 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33e6ffd640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33e80b7530 0x7f33e80c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33e67fc640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f33e80cf310 0x7f33e815a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33e77fe640 1 -- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f33e80cf310 msgr2=0x7f33e815a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33e77fe640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f33e80cf310 0x7f33e815a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33e77fe640 1 -- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33e80b7530 msgr2=0x7f33e80c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33e77fe640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33e80b7530 0x7f33e80c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.748+0000 7f33e77fe640 1 -- 172.21.15.63:0/1426208326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e8161540 con 0x7f33e815ef00 2024-09-21T07:01:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.749+0000 7f33e77fe640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33e815ef00 0x7f33e80c9c70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f33e000efc0 tx=0x7f33e000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.749+0000 7f33cf7fe640 1 -- 172.21.15.63:0/1426208326 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e001b070 con 0x7f33e815ef00 2024-09-21T07:01:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.749+0000 7f33cf7fe640 1 -- 172.21.15.63:0/1426208326 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33e0003b80 con 0x7f33e815ef00 2024-09-21T07:01:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.749+0000 7f33ed7ba640 1 -- 172.21.15.63:0/1426208326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e80ca1b0 con 0x7f33e815ef00 2024-09-21T07:01:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.749+0000 7f33cf7fe640 1 -- 172.21.15.63:0/1426208326 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0004030 con 0x7f33e815ef00 2024-09-21T07:01:08.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.749+0000 7f33ed7ba640 1 -- 172.21.15.63:0/1426208326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e81617e0 con 0x7f33e815ef00 2024-09-21T07:01:08.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.750+0000 7f33ed7ba640 1 -- 172.21.15.63:0/1426208326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e80ca3e0 con 0x7f33e815ef00 2024-09-21T07:01:08.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.751+0000 7f33cf7fe640 1 -- 172.21.15.63:0/1426208326 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f33e001e070 con 0x7f33e815ef00 2024-09-21T07:01:08.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.751+0000 7f33cf7fe640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f33d4078bc0 0x7f33d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:08.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.751+0000 7f33cf7fe640 1 -- 172.21.15.63:0/1426208326 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f33e009b360 con 0x7f33e815ef00 2024-09-21T07:01:08.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.751+0000 7f33e6ffd640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f33d4078bc0 0x7f33d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:08.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.752+0000 7f33e6ffd640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f33d4078bc0 0x7f33d407b0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f33e80d4660 tx=0x7f33d8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:08.756 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-09-21T07:01:08.755+0000 7eff8a0dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:01:08.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:08.756+0000 7f33cf7fe640 1 -- 172.21.15.63:0/1426208326 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f33e0063830 con 0x7f33e815ef00 2024-09-21T07:01:09.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.018+0000 7f33ed7ba640 1 -- 172.21.15.63:0/1426208326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f33e80d0700 con 0x7f33e815ef00 2024-09-21T07:01:09.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.019+0000 7f33cf7fe640 1 -- 172.21.15.63:0/1426208326 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2538 (secure 0 0 0) 0x7f33e0063130 con 0x7f33e815ef00 2024-09-21T07:01:09.021 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:09.021 INFO:teuthology.orchestra.run.smithi063.stdout:{"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":72,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1726902009,"num_in_osds":8,"osd_in_since":1726901999,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":225562624,"bytes_avail":772868550656,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"btime":"2024-09-21T07:01:06:786372+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4905}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-21T07:01:08.608780+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T07:01:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.021+0000 7f33ed7ba640 1 -- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f33d4078bc0 msgr2=0x7f33d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.021+0000 7f33ed7ba640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f33d4078bc0 0x7f33d407b0d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f33e80d4660 tx=0x7f33d8009040 comp rx=0 tx=0).stop 2024-09-21T07:01:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.021+0000 7f33ed7ba640 1 -- 172.21.15.63:0/1426208326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33e815ef00 msgr2=0x7f33e80c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.021+0000 7f33ed7ba640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33e815ef00 0x7f33e80c9c70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f33e000efc0 tx=0x7f33e000c800 comp rx=0 tx=0).stop 2024-09-21T07:01:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.021+0000 7f33ed7ba640 1 -- 172.21.15.63:0/1426208326 shutdown_connections 2024-09-21T07:01:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.021+0000 7f33ed7ba640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f33d4078bc0 0x7f33d407b0d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.021+0000 7f33ed7ba640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f33e815ef00 0x7f33e80c9c70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:09.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.021+0000 7f33ed7ba640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f33e80cf310 0x7f33e815a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.021+0000 7f33ed7ba640 1 --2- 172.21.15.63:0/1426208326 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f33e80b7530 0x7f33e80c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.021+0000 7f33ed7ba640 1 -- 172.21.15.63:0/1426208326 >> 172.21.15.63:0/1426208326 conn(0x7f33e808bfd0 msgr2=0x7f33e806e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.021+0000 7f33ed7ba640 1 -- 172.21.15.63:0/1426208326 shutdown_connections 2024-09-21T07:01:09.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.021+0000 7f33ed7ba640 1 -- 172.21.15.63:0/1426208326 wait complete. 2024-09-21T07:01:09.034 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T07:01:09.034 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:01:09.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.149+0000 7f405a98b640 1 -- 172.21.15.63:0/2785663987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4040005330 msgr2=0x7f404000b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:09.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.149+0000 7f405a98b640 1 --2- 172.21.15.63:0/2785663987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4040005330 0x7f404000b9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f405408df70 tx=0x7f4040005830 comp rx=0 tx=0).stop 2024-09-21T07:01:09.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.149+0000 7f405a98b640 1 -- 172.21.15.63:0/2785663987 shutdown_connections 2024-09-21T07:01:09.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.149+0000 7f405a98b640 1 --2- 172.21.15.63:0/2785663987 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4040005330 0x7f404000b9e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:09.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.149+0000 7f405a98b640 1 -- 172.21.15.63:0/2785663987 >> 172.21.15.63:0/2785663987 conn(0x7f405408bfd0 msgr2=0x7f40540d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:09.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.149+0000 7f405a98b640 1 -- 172.21.15.63:0/2785663987 shutdown_connections 2024-09-21T07:01:09.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.149+0000 7f405a98b640 1 -- 172.21.15.63:0/2785663987 wait complete. 2024-09-21T07:01:09.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.151+0000 7f405a98b640 1 Processor -- start 2024-09-21T07:01:09.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.151+0000 7f405a98b640 1 -- start start 2024-09-21T07:01:09.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f405a98b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4040005330 0x7f405414b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:09.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f405a98b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f405414deb0 0x7f405414e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:09.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f405a98b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40541f9250 0x7f40541f9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:09.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f405a98b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f40540d28c0 con 0x7f405414deb0 2024-09-21T07:01:09.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f405a98b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f40540d2740 con 0x7f4040005330 2024-09-21T07:01:09.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f405a98b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f40540d2a40 con 0x7f40541f9250 2024-09-21T07:01:09.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f40537fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f405414deb0 0x7f405414e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:09.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f40537fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f405414deb0 0x7f405414e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51478/0 (socket says 172.21.15.63:51478) 2024-09-21T07:01:09.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f40537fe640 1 -- 172.21.15.63:0/1912557363 learned_addr learned my addr 172.21.15.63:0/1912557363 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:09.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f4053fff640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4040005330 0x7f405414b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:09.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f4058f28640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40541f9250 0x7f40541f9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:09.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f40537fe640 1 -- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40541f9250 msgr2=0x7f40541f9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:09.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f40537fe640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40541f9250 0x7f40541f9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:09.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f40537fe640 1 -- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4040005330 msgr2=0x7f405414b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:09.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f40537fe640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4040005330 0x7f405414b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:09.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f40537fe640 1 -- 172.21.15.63:0/1912557363 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40541f9ba0 con 0x7f405414deb0 2024-09-21T07:01:09.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.153+0000 7f40537fe640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f405414deb0 0x7f405414e2c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f403c0066b0 tx=0x7f403c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:09.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.154+0000 7f4050ff9640 1 -- 172.21.15.63:0/1912557363 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c015070 con 0x7f405414deb0 2024-09-21T07:01:09.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.154+0000 7f4050ff9640 1 -- 172.21.15.63:0/1912557363 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f403c011900 con 0x7f405414deb0 2024-09-21T07:01:09.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.154+0000 7f405a98b640 1 -- 172.21.15.63:0/1912557363 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4054159ef0 con 0x7f405414deb0 2024-09-21T07:01:09.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.154+0000 7f4050ff9640 1 -- 172.21.15.63:0/1912557363 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403c011d50 con 0x7f405414deb0 2024-09-21T07:01:09.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.154+0000 7f405a98b640 1 -- 172.21.15.63:0/1912557363 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40540ca4c0 con 0x7f405414deb0 2024-09-21T07:01:09.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.155+0000 7f405a98b640 1 -- 172.21.15.63:0/1912557363 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40540b2860 con 0x7f405414deb0 2024-09-21T07:01:09.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.155+0000 7f4050ff9640 1 -- 172.21.15.63:0/1912557363 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f403c018070 con 0x7f405414deb0 2024-09-21T07:01:09.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.156+0000 7f4050ff9640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4034078b90 0x7f403407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:09.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.156+0000 7f4050ff9640 1 -- 172.21.15.63:0/1912557363 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f403c09b9d0 con 0x7f405414deb0 2024-09-21T07:01:09.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.156+0000 7f4053fff640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4034078b90 0x7f403407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:09.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.157+0000 7f4053fff640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4034078b90 0x7f403407b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4044000c00 tx=0x7f4044006bc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:09.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.161+0000 7f4050ff9640 1 -- 172.21.15.63:0/1912557363 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f40541f9ba0 con 0x7f405414deb0 2024-09-21T07:01:09.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.344+0000 7f405a98b640 1 -- 172.21.15.63:0/1912557363 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f405415e6a0 con 0x7f4034078b90 2024-09-21T07:01:09.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.349+0000 7f4050ff9640 1 -- 172.21.15.63:0/1912557363 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7f405415e6a0 con 0x7f4034078b90 2024-09-21T07:01:09.353 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:09.354 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:01:09.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.352+0000 7f405a98b640 1 -- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4034078b90 msgr2=0x7f403407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:09.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.352+0000 7f405a98b640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4034078b90 0x7f403407b0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4044000c00 tx=0x7f4044006bc0 comp rx=0 tx=0).stop 2024-09-21T07:01:09.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.352+0000 7f405a98b640 1 -- 172.21.15.63:0/1912557363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f405414deb0 msgr2=0x7f405414e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:09.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.352+0000 7f405a98b640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f405414deb0 0x7f405414e2c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f403c0066b0 tx=0x7f403c0039c0 comp rx=0 tx=0).stop 2024-09-21T07:01:09.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.352+0000 7f405a98b640 1 -- 172.21.15.63:0/1912557363 shutdown_connections 2024-09-21T07:01:09.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.352+0000 7f405a98b640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4034078b90 0x7f403407b0a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:09.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.352+0000 7f405a98b640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f40541f9250 0x7f40541f9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:09.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.352+0000 7f405a98b640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f405414deb0 0x7f405414e2c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:09.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.352+0000 7f405a98b640 1 --2- 172.21.15.63:0/1912557363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4040005330 0x7f405414b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:09.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.352+0000 7f405a98b640 1 -- 172.21.15.63:0/1912557363 >> 172.21.15.63:0/1912557363 conn(0x7f405408bfd0 msgr2=0x7f405415bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:09.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.352+0000 7f405a98b640 1 -- 172.21.15.63:0/1912557363 shutdown_connections 2024-09-21T07:01:09.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:09.352+0000 7f405a98b640 1 -- 172.21.15.63:0/1912557363 wait complete. 2024-09-21T07:01:09.365 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-21T07:01:08.608644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220276,"kb_used_data":4012,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754444,"statfs":{"total":773094113280,"available":772868550656,"internally_reserved":0,"allocated":4108288,"data_stored":2272168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,11],"upper_bound":32},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001344"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844066+0000","last_change":"2024-09-21T07:01:03.794142+0000","last_active":"2024-09-21T07:01:04.844066+0000","last_peered":"2024-09-21T07:01:04.844066+0000","last_clean":"2024-09-21T07:01:04.844066+0000","last_became_active":"2024-09-21T07:01:03.790316+0000","last_became_peered":"2024-09-21T07:01:03.790316+0000","last_unstale":"2024-09-21T07:01:04.844066+0000","last_undegraded":"2024-09-21T07:01:04.844066+0000","last_fullsized":"2024-09-21T07:01:04.844066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:19.787933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844566+0000","last_change":"2024-09-21T07:01:03.791660+0000","last_active":"2024-09-21T07:01:04.844566+0000","last_peered":"2024-09-21T07:01:04.844566+0000","last_clean":"2024-09-21T07:01:04.844566+0000","last_became_active":"2024-09-21T07:01:03.790741+0000","last_became_peered":"2024-09-21T07:01:03.790741+0000","last_unstale":"2024-09-21T07:01:04.844566+0000","last_undegraded":"2024-09-21T07:01:04.844566+0000","last_fullsized":"2024-09-21T07:01:04.844566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.262768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768560+0000","last_change":"2024-09-21T07:01:03.792492+0000","last_active":"2024-09-21T07:01:04.768560+0000","last_peered":"2024-09-21T07:01:04.768560+0000","last_clean":"2024-09-21T07:01:04.768560+0000","last_became_active":"2024-09-21T07:01:03.792164+0000","last_became_peered":"2024-09-21T07:01:03.792164+0000","last_unstale":"2024-09-21T07:01:04.768560+0000","last_undegraded":"2024-09-21T07:01:04.768560+0000","last_fullsized":"2024-09-21T07:01:04.768560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:38.201057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769210+0000","last_change":"2024-09-21T07:01:03.799627+0000","last_active":"2024-09-21T07:01:04.769210+0000","last_peered":"2024-09-21T07:01:04.769210+0000","last_clean":"2024-09-21T07:01:04.769210+0000","last_became_active":"2024-09-21T07:01:03.798990+0000","last_became_peered":"2024-09-21T07:01:03.798990+0000","last_unstale":"2024-09-21T07:01:04.769210+0000","last_undegraded":"2024-09-21T07:01:04.769210+0000","last_fullsized":"2024-09-21T07:01:04.769210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:31.551004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843541+0000","last_change":"2024-09-21T07:01:03.775605+0000","last_active":"2024-09-21T07:01:04.843541+0000","last_peered":"2024-09-21T07:01:04.843541+0000","last_clean":"2024-09-21T07:01:04.843541+0000","last_became_active":"2024-09-21T07:01:03.775096+0000","last_became_peered":"2024-09-21T07:01:03.775096+0000","last_unstale":"2024-09-21T07:01:04.843541+0000","last_undegraded":"2024-09-21T07:01:04.843541+0000","last_fullsized":"2024-09-21T07:01:04.843541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:23.836413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844759+0000","last_change":"2024-09-21T07:01:03.801253+0000","last_active":"2024-09-21T07:01:04.844759+0000","last_peered":"2024-09-21T07:01:04.844759+0000","last_clean":"2024-09-21T07:01:04.844759+0000","last_became_active":"2024-09-21T07:01:03.800920+0000","last_became_peered":"2024-09-21T07:01:03.800920+0000","last_unstale":"2024-09-21T07:01:04.844759+0000","last_undegraded":"2024-09-21T07:01:04.844759+0000","last_fullsized":"2024-09-21T07:01:04.844759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:42.751536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843408+0000","last_change":"2024-09-21T07:01:03.795428+0000","last_active":"2024-09-21T07:01:04.843408+0000","last_peered":"2024-09-21T07:01:04.843408+0000","last_clean":"2024-09-21T07:01:04.843408+0000","last_became_active":"2024-09-21T07:01:03.795098+0000","last_became_peered":"2024-09-21T07:01:03.795098+0000","last_unstale":"2024-09-21T07:01:04.843408+0000","last_undegraded":"2024-09-21T07:01:04.843408+0000","last_fullsized":"2024-09-21T07:01:04.843408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843685+0000","last_change":"2024-09-21T07:01:03.795965+0000","last_active":"2024-09-21T07:01:04.843685+0000","last_peered":"2024-09-21T07:01:04.843685+0000","last_clean":"2024-09-21T07:01:04.843685+0000","last_became_active":"2024-09-21T07:01:03.795485+0000","last_became_peered":"2024-09-21T07:01:03.795485+0000","last_unstale":"2024-09-21T07:01:04.843685+0000","last_undegraded":"2024-09-21T07:01:04.843685+0000","last_fullsized":"2024-09-21T07:01:04.843685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:45.129827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768692+0000","last_change":"2024-09-21T07:01:03.797379+0000","last_active":"2024-09-21T07:01:04.768692+0000","last_peered":"2024-09-21T07:01:04.768692+0000","last_clean":"2024-09-21T07:01:04.768692+0000","last_became_active":"2024-09-21T07:01:03.797038+0000","last_became_peered":"2024-09-21T07:01:03.797038+0000","last_unstale":"2024-09-21T07:01:04.768692+0000","last_undegraded":"2024-09-21T07:01:04.768692+0000","last_fullsized":"2024-09-21T07:01:04.768692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.981958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769463+0000","last_change":"2024-09-21T07:01:03.793354+0000","last_active":"2024-09-21T07:01:04.769463+0000","last_peered":"2024-09-21T07:01:04.769463+0000","last_clean":"2024-09-21T07:01:04.769463+0000","last_became_active":"2024-09-21T07:01:03.792998+0000","last_became_peered":"2024-09-21T07:01:03.792998+0000","last_unstale":"2024-09-21T07:01:04.769463+0000","last_undegraded":"2024-09-21T07:01:04.769463+0000","last_fullsized":"2024-09-21T07:01:04.769463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:26.579640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843680+0000","last_change":"2024-09-21T07:01:03.797615+0000","last_active":"2024-09-21T07:01:04.843680+0000","last_peered":"2024-09-21T07:01:04.843680+0000","last_clean":"2024-09-21T07:01:04.843680+0000","last_became_active":"2024-09-21T07:01:03.796962+0000","last_became_peered":"2024-09-21T07:01:03.796962+0000","last_unstale":"2024-09-21T07:01:04.843680+0000","last_undegraded":"2024-09-21T07:01:04.843680+0000","last_fullsized":"2024-09-21T07:01:04.843680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:29.202843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768150+0000","last_change":"2024-09-21T07:01:03.788053+0000","last_active":"2024-09-21T07:01:04.768150+0000","last_peered":"2024-09-21T07:01:04.768150+0000","last_clean":"2024-09-21T07:01:04.768150+0000","last_became_active":"2024-09-21T07:01:03.787728+0000","last_became_peered":"2024-09-21T07:01:03.787728+0000","last_unstale":"2024-09-21T07:01:04.768150+0000","last_undegraded":"2024-09-21T07:01:04.768150+0000","last_fullsized":"2024-09-21T07:01:04.768150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:44.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844461+0000","last_change":"2024-09-21T07:01:03.792564+0000","last_active":"2024-09-21T07:01:04.844461+0000","last_peered":"2024-09-21T07:01:04.844461+0000","last_clean":"2024-09-21T07:01:04.844461+0000","last_became_active":"2024-09-21T07:01:03.791629+0000","last_became_peered":"2024-09-21T07:01:03.791629+0000","last_unstale":"2024-09-21T07:01:04.844461+0000","last_undegraded":"2024-09-21T07:01:04.844461+0000","last_fullsized":"2024-09-21T07:01:04.844461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:58.610632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768644+0000","last_change":"2024-09-21T07:01:03.791933+0000","last_active":"2024-09-21T07:01:04.768644+0000","last_peered":"2024-09-21T07:01:04.768644+0000","last_clean":"2024-09-21T07:01:04.768644+0000","last_became_active":"2024-09-21T07:01:03.791599+0000","last_became_peered":"2024-09-21T07:01:03.791599+0000","last_unstale":"2024-09-21T07:01:04.768644+0000","last_undegraded":"2024-09-21T07:01:04.768644+0000","last_fullsized":"2024-09-21T07:01:04.768644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:10.931859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767157+0000","last_change":"2024-09-21T07:01:03.801933+0000","last_active":"2024-09-21T07:01:04.767157+0000","last_peered":"2024-09-21T07:01:04.767157+0000","last_clean":"2024-09-21T07:01:04.767157+0000","last_became_active":"2024-09-21T07:01:03.801563+0000","last_became_peered":"2024-09-21T07:01:03.801563+0000","last_unstale":"2024-09-21T07:01:04.767157+0000","last_undegraded":"2024-09-21T07:01:04.767157+0000","last_fullsized":"2024-09-21T07:01:04.767157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:34.894160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767121+0000","last_change":"2024-09-21T07:01:03.787523+0000","last_active":"2024-09-21T07:01:04.767121+0000","last_peered":"2024-09-21T07:01:04.767121+0000","last_clean":"2024-09-21T07:01:04.767121+0000","last_became_active":"2024-09-21T07:01:03.786731+0000","last_became_peered":"2024-09-21T07:01:03.786731+0000","last_unstale":"2024-09-21T07:01:04.767121+0000","last_undegraded":"2024-09-21T07:01:04.767121+0000","last_fullsized":"2024-09-21T07:01:04.767121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:11.993232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843403+0000","last_change":"2024-09-21T07:01:03.799976+0000","last_active":"2024-09-21T07:01:04.843403+0000","last_peered":"2024-09-21T07:01:04.843403+0000","last_clean":"2024-09-21T07:01:04.843403+0000","last_became_active":"2024-09-21T07:01:03.799425+0000","last_became_peered":"2024-09-21T07:01:03.799425+0000","last_unstale":"2024-09-21T07:01:04.843403+0000","last_undegraded":"2024-09-21T07:01:04.843403+0000","last_fullsized":"2024-09-21T07:01:04.843403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:37.275079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844401+0000","last_change":"2024-09-21T07:01:03.781832+0000","last_active":"2024-09-21T07:01:04.844401+0000","last_peered":"2024-09-21T07:01:04.844401+0000","last_clean":"2024-09-21T07:01:04.844401+0000","last_became_active":"2024-09-21T07:01:03.779709+0000","last_became_peered":"2024-09-21T07:01:03.779709+0000","last_unstale":"2024-09-21T07:01:04.844401+0000","last_undegraded":"2024-09-21T07:01:04.844401+0000","last_fullsized":"2024-09-21T07:01:04.844401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:04.995003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844689+0000","last_change":"2024-09-21T07:01:03.788320+0000","last_active":"2024-09-21T07:01:04.844689+0000","last_peered":"2024-09-21T07:01:04.844689+0000","last_clean":"2024-09-21T07:01:04.844689+0000","last_became_active":"2024-09-21T07:01:03.787978+0000","last_became_peered":"2024-09-21T07:01:03.787978+0000","last_unstale":"2024-09-21T07:01:04.844689+0000","last_undegraded":"2024-09-21T07:01:04.844689+0000","last_fullsized":"2024-09-21T07:01:04.844689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:18.875542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844064+0000","last_change":"2024-09-21T07:01:03.792145+0000","last_active":"2024-09-21T07:01:04.844064+0000","last_peered":"2024-09-21T07:01:04.844064+0000","last_clean":"2024-09-21T07:01:04.844064+0000","last_became_active":"2024-09-21T07:01:03.791766+0000","last_became_peered":"2024-09-21T07:01:03.791766+0000","last_unstale":"2024-09-21T07:01:04.844064+0000","last_undegraded":"2024-09-21T07:01:04.844064+0000","last_fullsized":"2024-09-21T07:01:04.844064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:45.001116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767414+0000","last_change":"2024-09-21T07:01:03.788762+0000","last_active":"2024-09-21T07:01:04.767414+0000","last_peered":"2024-09-21T07:01:04.767414+0000","last_clean":"2024-09-21T07:01:04.767414+0000","last_became_active":"2024-09-21T07:01:03.788372+0000","last_became_peered":"2024-09-21T07:01:03.788372+0000","last_unstale":"2024-09-21T07:01:04.767414+0000","last_undegraded":"2024-09-21T07:01:04.767414+0000","last_fullsized":"2024-09-21T07:01:04.767414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:19.787933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843211+0000","last_change":"2024-09-21T07:01:03.799507+0000","last_active":"2024-09-21T07:01:04.843211+0000","last_peered":"2024-09-21T07:01:04.843211+0000","last_clean":"2024-09-21T07:01:04.843211+0000","last_became_active":"2024-09-21T07:01:03.798713+0000","last_became_peered":"2024-09-21T07:01:03.798713+0000","last_unstale":"2024-09-21T07:01:04.843211+0000","last_undegraded":"2024-09-21T07:01:04.843211+0000","last_fullsized":"2024-09-21T07:01:04.843211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:42.573263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843765+0000","last_change":"2024-09-21T07:01:03.781265+0000","last_active":"2024-09-21T07:01:04.843765+0000","last_peered":"2024-09-21T07:01:04.843765+0000","last_clean":"2024-09-21T07:01:04.843765+0000","last_became_active":"2024-09-21T07:01:03.780969+0000","last_became_peered":"2024-09-21T07:01:03.780969+0000","last_unstale":"2024-09-21T07:01:04.843765+0000","last_undegraded":"2024-09-21T07:01:04.843765+0000","last_fullsized":"2024-09-21T07:01:04.843765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:59.851233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843141+0000","last_change":"2024-09-21T07:01:03.799128+0000","last_active":"2024-09-21T07:01:04.843141+0000","last_peered":"2024-09-21T07:01:04.843141+0000","last_clean":"2024-09-21T07:01:04.843141+0000","last_became_active":"2024-09-21T07:01:03.798706+0000","last_became_peered":"2024-09-21T07:01:03.798706+0000","last_unstale":"2024-09-21T07:01:04.843141+0000","last_undegraded":"2024-09-21T07:01:04.843141+0000","last_fullsized":"2024-09-21T07:01:04.843141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:56.371767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769254+0000","last_change":"2024-09-21T07:01:03.800165+0000","last_active":"2024-09-21T07:01:04.769254+0000","last_peered":"2024-09-21T07:01:04.769254+0000","last_clean":"2024-09-21T07:01:04.769254+0000","last_became_active":"2024-09-21T07:01:03.799818+0000","last_became_peered":"2024-09-21T07:01:03.799818+0000","last_unstale":"2024-09-21T07:01:04.769254+0000","last_undegraded":"2024-09-21T07:01:04.769254+0000","last_fullsized":"2024-09-21T07:01:04.769254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:03.393628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769248+0000","last_change":"2024-09-21T07:01:03.791524+0000","last_active":"2024-09-21T07:01:04.769248+0000","last_peered":"2024-09-21T07:01:04.769248+0000","last_clean":"2024-09-21T07:01:04.769248+0000","last_became_active":"2024-09-21T07:01:03.791175+0000","last_became_peered":"2024-09-21T07:01:03.791175+0000","last_unstale":"2024-09-21T07:01:04.769248+0000","last_undegraded":"2024-09-21T07:01:04.769248+0000","last_fullsized":"2024-09-21T07:01:04.769248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:41.064395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844561+0000","last_change":"2024-09-21T07:01:03.789643+0000","last_active":"2024-09-21T07:01:04.844561+0000","last_peered":"2024-09-21T07:01:04.844561+0000","last_clean":"2024-09-21T07:01:04.844561+0000","last_became_active":"2024-09-21T07:01:03.789249+0000","last_became_peered":"2024-09-21T07:01:03.789249+0000","last_unstale":"2024-09-21T07:01:04.844561+0000","last_undegraded":"2024-09-21T07:01:04.844561+0000","last_fullsized":"2024-09-21T07:01:04.844561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:24.747636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844048+0000","last_change":"2024-09-21T07:01:03.793850+0000","last_active":"2024-09-21T07:01:04.844048+0000","last_peered":"2024-09-21T07:01:04.844048+0000","last_clean":"2024-09-21T07:01:04.844048+0000","last_became_active":"2024-09-21T07:01:03.790220+0000","last_became_peered":"2024-09-21T07:01:03.790220+0000","last_unstale":"2024-09-21T07:01:04.844048+0000","last_undegraded":"2024-09-21T07:01:04.844048+0000","last_fullsized":"2024-09-21T07:01:04.844048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.262768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767762+0000","last_change":"2024-09-21T07:01:03.802120+0000","last_active":"2024-09-21T07:01:04.767762+0000","last_peered":"2024-09-21T07:01:04.767762+0000","last_clean":"2024-09-21T07:01:04.767762+0000","last_became_active":"2024-09-21T07:01:03.801699+0000","last_became_peered":"2024-09-21T07:01:03.801699+0000","last_unstale":"2024-09-21T07:01:04.767762+0000","last_undegraded":"2024-09-21T07:01:04.767762+0000","last_fullsized":"2024-09-21T07:01:04.767762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:16.741550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767176+0000","last_change":"2024-09-21T07:01:03.779994+0000","last_active":"2024-09-21T07:01:04.767176+0000","last_peered":"2024-09-21T07:01:04.767176+0000","last_clean":"2024-09-21T07:01:04.767176+0000","last_became_active":"2024-09-21T07:01:03.779267+0000","last_became_peered":"2024-09-21T07:01:03.779267+0000","last_unstale":"2024-09-21T07:01:04.767176+0000","last_undegraded":"2024-09-21T07:01:04.767176+0000","last_fullsized":"2024-09-21T07:01:04.767176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:24.747636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843248+0000","last_change":"2024-09-21T07:01:03.799390+0000","last_active":"2024-09-21T07:01:04.843248+0000","last_peered":"2024-09-21T07:01:04.843248+0000","last_clean":"2024-09-21T07:01:04.843248+0000","last_became_active":"2024-09-21T07:01:03.799078+0000","last_became_peered":"2024-09-21T07:01:03.799078+0000","last_unstale":"2024-09-21T07:01:04.843248+0000","last_undegraded":"2024-09-21T07:01:04.843248+0000","last_fullsized":"2024-09-21T07:01:04.843248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:36.565399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843261+0000","last_change":"2024-09-21T07:01:03.800557+0000","last_active":"2024-09-21T07:01:04.843261+0000","last_peered":"2024-09-21T07:01:04.843261+0000","last_clean":"2024-09-21T07:01:04.843261+0000","last_became_active":"2024-09-21T07:01:03.800262+0000","last_became_peered":"2024-09-21T07:01:03.800262+0000","last_unstale":"2024-09-21T07:01:04.843261+0000","last_undegraded":"2024-09-21T07:01:04.843261+0000","last_fullsized":"2024-09-21T07:01:04.843261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:06.031208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844973+0000","last_change":"2024-09-21T07:01:03.781597+0000","last_active":"2024-09-21T07:01:04.844973+0000","last_peered":"2024-09-21T07:01:04.844973+0000","last_clean":"2024-09-21T07:01:04.844973+0000","last_became_active":"2024-09-21T07:01:03.781303+0000","last_became_peered":"2024-09-21T07:01:03.781303+0000","last_unstale":"2024-09-21T07:01:04.844973+0000","last_undegraded":"2024-09-21T07:01:04.844973+0000","last_fullsized":"2024-09-21T07:01:04.844973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:42.573263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843625+0000","last_change":"2024-09-21T07:01:02.778634+0000","last_active":"2024-09-21T07:01:04.843625+0000","last_peered":"2024-09-21T07:01:04.843625+0000","last_clean":"2024-09-21T07:01:04.843625+0000","last_became_active":"2024-09-21T07:01:02.778310+0000","last_became_peered":"2024-09-21T07:01:02.778310+0000","last_unstale":"2024-09-21T07:01:04.843625+0000","last_undegraded":"2024-09-21T07:01:04.843625+0000","last_fullsized":"2024-09-21T07:01:04.843625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:39.995378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844286+0000","last_change":"2024-09-21T07:01:03.801557+0000","last_active":"2024-09-21T07:01:04.844286+0000","last_peered":"2024-09-21T07:01:04.844286+0000","last_clean":"2024-09-21T07:01:04.844286+0000","last_became_active":"2024-09-21T07:01:03.801233+0000","last_became_peered":"2024-09-21T07:01:03.801233+0000","last_unstale":"2024-09-21T07:01:04.844286+0000","last_undegraded":"2024-09-21T07:01:04.844286+0000","last_fullsized":"2024-09-21T07:01:04.844286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:23:01.557172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769391+0000","last_change":"2024-09-21T07:01:02.773667+0000","last_active":"2024-09-21T07:01:04.769391+0000","last_peered":"2024-09-21T07:01:04.769391+0000","last_clean":"2024-09-21T07:01:04.769391+0000","last_became_active":"2024-09-21T07:01:02.772500+0000","last_became_peered":"2024-09-21T07:01:02.772500+0000","last_unstale":"2024-09-21T07:01:04.769391+0000","last_undegraded":"2024-09-21T07:01:04.769391+0000","last_fullsized":"2024-09-21T07:01:04.769391+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:35.712366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844178+0000","last_change":"2024-09-21T07:01:03.799022+0000","last_active":"2024-09-21T07:01:04.844178+0000","last_peered":"2024-09-21T07:01:04.844178+0000","last_clean":"2024-09-21T07:01:04.844178+0000","last_became_active":"2024-09-21T07:01:03.798589+0000","last_became_peered":"2024-09-21T07:01:03.798589+0000","last_unstale":"2024-09-21T07:01:04.844178+0000","last_undegraded":"2024-09-21T07:01:04.844178+0000","last_fullsized":"2024-09-21T07:01:04.844178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:21.629179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.845030+0000","last_change":"2024-09-21T07:01:02.785856+0000","last_active":"2024-09-21T07:01:04.845030+0000","last_peered":"2024-09-21T07:01:04.845030+0000","last_clean":"2024-09-21T07:01:04.845030+0000","last_became_active":"2024-09-21T07:01:02.785426+0000","last_became_peered":"2024-09-21T07:01:02.785426+0000","last_unstale":"2024-09-21T07:01:04.845030+0000","last_undegraded":"2024-09-21T07:01:04.845030+0000","last_fullsized":"2024-09-21T07:01:04.845030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:21.317089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769032+0000","last_change":"2024-09-21T07:01:03.787829+0000","last_active":"2024-09-21T07:01:04.769032+0000","last_peered":"2024-09-21T07:01:04.769032+0000","last_clean":"2024-09-21T07:01:04.769032+0000","last_became_active":"2024-09-21T07:01:03.787463+0000","last_became_peered":"2024-09-21T07:01:03.787463+0000","last_unstale":"2024-09-21T07:01:04.769032+0000","last_undegraded":"2024-09-21T07:01:04.769032+0000","last_fullsized":"2024-09-21T07:01:04.769032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:38.992018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769363+0000","last_change":"2024-09-21T07:01:02.774070+0000","last_active":"2024-09-21T07:01:04.769363+0000","last_peered":"2024-09-21T07:01:04.769363+0000","last_clean":"2024-09-21T07:01:04.769363+0000","last_became_active":"2024-09-21T07:01:02.773750+0000","last_became_peered":"2024-09-21T07:01:02.773750+0000","last_unstale":"2024-09-21T07:01:04.769363+0000","last_undegraded":"2024-09-21T07:01:04.769363+0000","last_fullsized":"2024-09-21T07:01:04.769363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:25.293735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768173+0000","last_change":"2024-09-21T07:01:03.796538+0000","last_active":"2024-09-21T07:01:04.768173+0000","last_peered":"2024-09-21T07:01:04.768173+0000","last_clean":"2024-09-21T07:01:04.768173+0000","last_became_active":"2024-09-21T07:01:03.796196+0000","last_became_peered":"2024-09-21T07:01:03.796196+0000","last_unstale":"2024-09-21T07:01:04.768173+0000","last_undegraded":"2024-09-21T07:01:04.768173+0000","last_fullsized":"2024-09-21T07:01:04.768173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:33.760115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843918+0000","last_change":"2024-09-21T07:01:02.791472+0000","last_active":"2024-09-21T07:01:04.843918+0000","last_peered":"2024-09-21T07:01:04.843918+0000","last_clean":"2024-09-21T07:01:04.843918+0000","last_became_active":"2024-09-21T07:01:02.791087+0000","last_became_peered":"2024-09-21T07:01:02.791087+0000","last_unstale":"2024-09-21T07:01:04.843918+0000","last_undegraded":"2024-09-21T07:01:04.843918+0000","last_fullsized":"2024-09-21T07:01:04.843918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:37.195545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843171+0000","last_change":"2024-09-21T07:01:03.800189+0000","last_active":"2024-09-21T07:01:04.843171+0000","last_peered":"2024-09-21T07:01:04.843171+0000","last_clean":"2024-09-21T07:01:04.843171+0000","last_became_active":"2024-09-21T07:01:03.799901+0000","last_became_peered":"2024-09-21T07:01:03.799901+0000","last_unstale":"2024-09-21T07:01:04.843171+0000","last_undegraded":"2024-09-21T07:01:04.843171+0000","last_fullsized":"2024-09-21T07:01:04.843171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:58.610632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843353+0000","last_change":"2024-09-21T07:01:02.786240+0000","last_active":"2024-09-21T07:01:04.843353+0000","last_peered":"2024-09-21T07:01:04.843353+0000","last_clean":"2024-09-21T07:01:04.843353+0000","last_became_active":"2024-09-21T07:01:02.785829+0000","last_became_peered":"2024-09-21T07:01:02.785829+0000","last_unstale":"2024-09-21T07:01:04.843353+0000","last_undegraded":"2024-09-21T07:01:04.843353+0000","last_fullsized":"2024-09-21T07:01:04.843353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:52.905472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768169+0000","last_change":"2024-09-21T07:01:03.790770+0000","last_active":"2024-09-21T07:01:04.768169+0000","last_peered":"2024-09-21T07:01:04.768169+0000","last_clean":"2024-09-21T07:01:04.768169+0000","last_became_active":"2024-09-21T07:01:03.790466+0000","last_became_peered":"2024-09-21T07:01:03.790466+0000","last_unstale":"2024-09-21T07:01:04.768169+0000","last_undegraded":"2024-09-21T07:01:04.768169+0000","last_fullsized":"2024-09-21T07:01:04.768169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:39.192000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843624+0000","last_change":"2024-09-21T07:01:02.777473+0000","last_active":"2024-09-21T07:01:04.843624+0000","last_peered":"2024-09-21T07:01:04.843624+0000","last_clean":"2024-09-21T07:01:04.843624+0000","last_became_active":"2024-09-21T07:01:02.777116+0000","last_became_peered":"2024-09-21T07:01:02.777116+0000","last_unstale":"2024-09-21T07:01:04.843624+0000","last_undegraded":"2024-09-21T07:01:04.843624+0000","last_fullsized":"2024-09-21T07:01:04.843624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:59:40.790513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768296+0000","last_change":"2024-09-21T07:01:03.782050+0000","last_active":"2024-09-21T07:01:04.768296+0000","last_peered":"2024-09-21T07:01:04.768296+0000","last_clean":"2024-09-21T07:01:04.768296+0000","last_became_active":"2024-09-21T07:01:03.781742+0000","last_became_peered":"2024-09-21T07:01:03.781742+0000","last_unstale":"2024-09-21T07:01:04.768296+0000","last_undegraded":"2024-09-21T07:01:04.768296+0000","last_fullsized":"2024-09-21T07:01:04.768296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:00.690893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843506+0000","last_change":"2024-09-21T07:01:02.783052+0000","last_active":"2024-09-21T07:01:04.843506+0000","last_peered":"2024-09-21T07:01:04.843506+0000","last_clean":"2024-09-21T07:01:04.843506+0000","last_became_active":"2024-09-21T07:01:02.782729+0000","last_became_peered":"2024-09-21T07:01:02.782729+0000","last_unstale":"2024-09-21T07:01:04.843506+0000","last_undegraded":"2024-09-21T07:01:04.843506+0000","last_fullsized":"2024-09-21T07:01:04.843506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.976446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844084+0000","last_change":"2024-09-21T07:01:03.772763+0000","last_active":"2024-09-21T07:01:04.844084+0000","last_peered":"2024-09-21T07:01:04.844084+0000","last_clean":"2024-09-21T07:01:04.844084+0000","last_became_active":"2024-09-21T07:01:03.772413+0000","last_became_peered":"2024-09-21T07:01:03.772413+0000","last_unstale":"2024-09-21T07:01:04.844084+0000","last_undegraded":"2024-09-21T07:01:04.844084+0000","last_fullsized":"2024-09-21T07:01:04.844084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:04.294355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844234+0000","last_change":"2024-09-21T07:01:02.780860+0000","last_active":"2024-09-21T07:01:04.844234+0000","last_peered":"2024-09-21T07:01:04.844234+0000","last_clean":"2024-09-21T07:01:04.844234+0000","last_became_active":"2024-09-21T07:01:02.780296+0000","last_became_peered":"2024-09-21T07:01:02.780296+0000","last_unstale":"2024-09-21T07:01:04.844234+0000","last_undegraded":"2024-09-21T07:01:04.844234+0000","last_fullsized":"2024-09-21T07:01:04.844234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:36.181080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769199+0000","last_change":"2024-09-21T07:01:03.793872+0000","last_active":"2024-09-21T07:01:04.769199+0000","last_peered":"2024-09-21T07:01:04.769199+0000","last_clean":"2024-09-21T07:01:04.769199+0000","last_became_active":"2024-09-21T07:01:03.793469+0000","last_became_peered":"2024-09-21T07:01:03.793469+0000","last_unstale":"2024-09-21T07:01:04.769199+0000","last_undegraded":"2024-09-21T07:01:04.769199+0000","last_fullsized":"2024-09-21T07:01:04.769199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:42.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844702+0000","last_change":"2024-09-21T07:01:02.781901+0000","last_active":"2024-09-21T07:01:04.844702+0000","last_peered":"2024-09-21T07:01:04.844702+0000","last_clean":"2024-09-21T07:01:04.844702+0000","last_became_active":"2024-09-21T07:01:02.781563+0000","last_became_peered":"2024-09-21T07:01:02.781563+0000","last_unstale":"2024-09-21T07:01:04.844702+0000","last_undegraded":"2024-09-21T07:01:04.844702+0000","last_fullsized":"2024-09-21T07:01:04.844702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:20.713409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769430+0000","last_change":"2024-09-21T07:01:03.798837+0000","last_active":"2024-09-21T07:01:04.769430+0000","last_peered":"2024-09-21T07:01:04.769430+0000","last_clean":"2024-09-21T07:01:04.769430+0000","last_became_active":"2024-09-21T07:01:03.798557+0000","last_became_peered":"2024-09-21T07:01:03.798557+0000","last_unstale":"2024-09-21T07:01:04.769430+0000","last_undegraded":"2024-09-21T07:01:04.769430+0000","last_fullsized":"2024-09-21T07:01:04.769430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:14.507038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843954+0000","last_change":"2024-09-21T07:01:02.782653+0000","last_active":"2024-09-21T07:01:04.843954+0000","last_peered":"2024-09-21T07:01:04.843954+0000","last_clean":"2024-09-21T07:01:04.843954+0000","last_became_active":"2024-09-21T07:01:02.782261+0000","last_became_peered":"2024-09-21T07:01:02.782261+0000","last_unstale":"2024-09-21T07:01:04.843954+0000","last_undegraded":"2024-09-21T07:01:04.843954+0000","last_fullsized":"2024-09-21T07:01:04.843954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:15.736038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843335+0000","last_change":"2024-09-21T07:01:03.796498+0000","last_active":"2024-09-21T07:01:04.843335+0000","last_peered":"2024-09-21T07:01:04.843335+0000","last_clean":"2024-09-21T07:01:04.843335+0000","last_became_active":"2024-09-21T07:01:03.796169+0000","last_became_peered":"2024-09-21T07:01:03.796169+0000","last_unstale":"2024-09-21T07:01:04.843335+0000","last_undegraded":"2024-09-21T07:01:04.843335+0000","last_fullsized":"2024-09-21T07:01:04.843335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:50.551965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844229+0000","last_change":"2024-09-21T07:01:02.775824+0000","last_active":"2024-09-21T07:01:04.844229+0000","last_peered":"2024-09-21T07:01:04.844229+0000","last_clean":"2024-09-21T07:01:04.844229+0000","last_became_active":"2024-09-21T07:01:02.775228+0000","last_became_peered":"2024-09-21T07:01:02.775228+0000","last_unstale":"2024-09-21T07:01:04.844229+0000","last_undegraded":"2024-09-21T07:01:04.844229+0000","last_fullsized":"2024-09-21T07:01:04.844229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:37.195545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843771+0000","last_change":"2024-09-21T07:01:03.780446+0000","last_active":"2024-09-21T07:01:04.843771+0000","last_peered":"2024-09-21T07:01:04.843771+0000","last_clean":"2024-09-21T07:01:04.843771+0000","last_became_active":"2024-09-21T07:01:03.780180+0000","last_became_peered":"2024-09-21T07:01:03.780180+0000","last_unstale":"2024-09-21T07:01:04.843771+0000","last_undegraded":"2024-09-21T07:01:04.843771+0000","last_fullsized":"2024-09-21T07:01:04.843771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:57.734540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844036+0000","last_change":"2024-09-21T07:01:02.783777+0000","last_active":"2024-09-21T07:01:04.844036+0000","last_peered":"2024-09-21T07:01:04.844036+0000","last_clean":"2024-09-21T07:01:04.844036+0000","last_became_active":"2024-09-21T07:01:02.783438+0000","last_became_peered":"2024-09-21T07:01:02.783438+0000","last_unstale":"2024-09-21T07:01:04.844036+0000","last_undegraded":"2024-09-21T07:01:04.844036+0000","last_fullsized":"2024-09-21T07:01:04.844036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:44.480439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769199+0000","last_change":"2024-09-21T07:01:03.787869+0000","last_active":"2024-09-21T07:01:04.769199+0000","last_peered":"2024-09-21T07:01:04.769199+0000","last_clean":"2024-09-21T07:01:04.769199+0000","last_became_active":"2024-09-21T07:01:03.787492+0000","last_became_peered":"2024-09-21T07:01:03.787492+0000","last_unstale":"2024-09-21T07:01:04.769199+0000","last_undegraded":"2024-09-21T07:01:04.769199+0000","last_fullsized":"2024-09-21T07:01:04.769199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:49.483318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768429+0000","last_change":"2024-09-21T07:01:02.780251+0000","last_active":"2024-09-21T07:01:04.768429+0000","last_peered":"2024-09-21T07:01:04.768429+0000","last_clean":"2024-09-21T07:01:04.768429+0000","last_became_active":"2024-09-21T07:01:02.779917+0000","last_became_peered":"2024-09-21T07:01:02.779917+0000","last_unstale":"2024-09-21T07:01:04.768429+0000","last_undegraded":"2024-09-21T07:01:04.768429+0000","last_fullsized":"2024-09-21T07:01:04.768429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:57.090924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843383+0000","last_change":"2024-09-21T07:01:03.798215+0000","last_active":"2024-09-21T07:01:04.843383+0000","last_peered":"2024-09-21T07:01:04.843383+0000","last_clean":"2024-09-21T07:01:04.843383+0000","last_became_active":"2024-09-21T07:01:03.796516+0000","last_became_peered":"2024-09-21T07:01:03.796516+0000","last_unstale":"2024-09-21T07:01:04.843383+0000","last_undegraded":"2024-09-21T07:01:04.843383+0000","last_fullsized":"2024-09-21T07:01:04.843383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:28.466335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768049+0000","last_change":"2024-09-21T07:01:02.773936+0000","last_active":"2024-09-21T07:01:04.768049+0000","last_peered":"2024-09-21T07:01:04.768049+0000","last_clean":"2024-09-21T07:01:04.768049+0000","last_became_active":"2024-09-21T07:01:02.773244+0000","last_became_peered":"2024-09-21T07:01:02.773244+0000","last_unstale":"2024-09-21T07:01:04.768049+0000","last_undegraded":"2024-09-21T07:01:04.768049+0000","last_fullsized":"2024-09-21T07:01:04.768049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:40.459222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843741+0000","last_change":"2024-09-21T07:01:03.791099+0000","last_active":"2024-09-21T07:01:04.843741+0000","last_peered":"2024-09-21T07:01:04.843741+0000","last_clean":"2024-09-21T07:01:04.843741+0000","last_became_active":"2024-09-21T07:01:03.790772+0000","last_became_peered":"2024-09-21T07:01:03.790772+0000","last_unstale":"2024-09-21T07:01:04.843741+0000","last_undegraded":"2024-09-21T07:01:04.843741+0000","last_fullsized":"2024-09-21T07:01:04.843741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:33.139496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843700+0000","last_change":"2024-09-21T07:01:02.782460+0000","last_active":"2024-09-21T07:01:04.843700+0000","last_peered":"2024-09-21T07:01:04.843700+0000","last_clean":"2024-09-21T07:01:04.843700+0000","last_became_active":"2024-09-21T07:01:02.782160+0000","last_became_peered":"2024-09-21T07:01:02.782160+0000","last_unstale":"2024-09-21T07:01:04.843700+0000","last_undegraded":"2024-09-21T07:01:04.843700+0000","last_fullsized":"2024-09-21T07:01:04.843700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:24.532930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844055+0000","last_change":"2024-09-21T07:01:03.789639+0000","last_active":"2024-09-21T07:01:04.844055+0000","last_peered":"2024-09-21T07:01:04.844055+0000","last_clean":"2024-09-21T07:01:04.844055+0000","last_became_active":"2024-09-21T07:01:03.789329+0000","last_became_peered":"2024-09-21T07:01:03.789329+0000","last_unstale":"2024-09-21T07:01:04.844055+0000","last_undegraded":"2024-09-21T07:01:04.844055+0000","last_fullsized":"2024-09-21T07:01:04.844055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:28.686912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843894+0000","last_change":"2024-09-21T07:01:02.780877+0000","last_active":"2024-09-21T07:01:04.843894+0000","last_peered":"2024-09-21T07:01:04.843894+0000","last_clean":"2024-09-21T07:01:04.843894+0000","last_became_active":"2024-09-21T07:01:02.780530+0000","last_became_peered":"2024-09-21T07:01:02.780530+0000","last_unstale":"2024-09-21T07:01:04.843894+0000","last_undegraded":"2024-09-21T07:01:04.843894+0000","last_fullsized":"2024-09-21T07:01:04.843894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:28.933785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768917+0000","last_change":"2024-09-21T07:01:03.790197+0000","last_active":"2024-09-21T07:01:04.768917+0000","last_peered":"2024-09-21T07:01:04.768917+0000","last_clean":"2024-09-21T07:01:04.768917+0000","last_became_active":"2024-09-21T07:01:03.789769+0000","last_became_peered":"2024-09-21T07:01:03.789769+0000","last_unstale":"2024-09-21T07:01:04.768917+0000","last_undegraded":"2024-09-21T07:01:04.768917+0000","last_fullsized":"2024-09-21T07:01:04.768917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:32.176127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844415+0000","last_change":"2024-09-21T07:01:02.792339+0000","last_active":"2024-09-21T07:01:04.844415+0000","last_peered":"2024-09-21T07:01:04.844415+0000","last_clean":"2024-09-21T07:01:04.844415+0000","last_became_active":"2024-09-21T07:01:02.791971+0000","last_became_peered":"2024-09-21T07:01:02.791971+0000","last_unstale":"2024-09-21T07:01:04.844415+0000","last_undegraded":"2024-09-21T07:01:04.844415+0000","last_fullsized":"2024-09-21T07:01:04.844415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:43.713520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844168+0000","last_change":"2024-09-21T07:01:03.782318+0000","last_active":"2024-09-21T07:01:04.844168+0000","last_peered":"2024-09-21T07:01:04.844168+0000","last_clean":"2024-09-21T07:01:04.844168+0000","last_became_active":"2024-09-21T07:01:03.781942+0000","last_became_peered":"2024-09-21T07:01:03.781942+0000","last_unstale":"2024-09-21T07:01:04.844168+0000","last_undegraded":"2024-09-21T07:01:04.844168+0000","last_fullsized":"2024-09-21T07:01:04.844168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:34.894160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843829+0000","last_change":"2024-09-21T07:01:02.779001+0000","last_active":"2024-09-21T07:01:04.843829+0000","last_peered":"2024-09-21T07:01:04.843829+0000","last_clean":"2024-09-21T07:01:04.843829+0000","last_became_active":"2024-09-21T07:01:02.778522+0000","last_became_peered":"2024-09-21T07:01:02.778522+0000","last_unstale":"2024-09-21T07:01:04.843829+0000","last_undegraded":"2024-09-21T07:01:04.843829+0000","last_fullsized":"2024-09-21T07:01:04.843829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:03.188520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844992+0000","last_change":"2024-09-21T07:01:03.790572+0000","last_active":"2024-09-21T07:01:04.844992+0000","last_peered":"2024-09-21T07:01:04.844992+0000","last_clean":"2024-09-21T07:01:04.844992+0000","last_became_active":"2024-09-21T07:01:03.790070+0000","last_became_peered":"2024-09-21T07:01:03.790070+0000","last_unstale":"2024-09-21T07:01:04.844992+0000","last_undegraded":"2024-09-21T07:01:04.844992+0000","last_fullsized":"2024-09-21T07:01:04.844992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:40.124786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767672+0000","last_change":"2024-09-21T07:01:02.778072+0000","last_active":"2024-09-21T07:01:04.767672+0000","last_peered":"2024-09-21T07:01:04.767672+0000","last_clean":"2024-09-21T07:01:04.767672+0000","last_became_active":"2024-09-21T07:01:02.777714+0000","last_became_peered":"2024-09-21T07:01:02.777714+0000","last_unstale":"2024-09-21T07:01:04.767672+0000","last_undegraded":"2024-09-21T07:01:04.767672+0000","last_fullsized":"2024-09-21T07:01:04.767672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:05.574202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844019+0000","last_change":"2024-09-21T07:01:03.792264+0000","last_active":"2024-09-21T07:01:04.844019+0000","last_peered":"2024-09-21T07:01:04.844019+0000","last_clean":"2024-09-21T07:01:04.844019+0000","last_became_active":"2024-09-21T07:01:03.791787+0000","last_became_peered":"2024-09-21T07:01:03.791787+0000","last_unstale":"2024-09-21T07:01:04.844019+0000","last_undegraded":"2024-09-21T07:01:04.844019+0000","last_fullsized":"2024-09-21T07:01:04.844019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843915+0000","last_change":"2024-09-21T07:01:02.778713+0000","last_active":"2024-09-21T07:01:04.843915+0000","last_peered":"2024-09-21T07:01:04.843915+0000","last_clean":"2024-09-21T07:01:04.843915+0000","last_became_active":"2024-09-21T07:01:02.778375+0000","last_became_peered":"2024-09-21T07:01:02.778375+0000","last_unstale":"2024-09-21T07:01:04.843915+0000","last_undegraded":"2024-09-21T07:01:04.843915+0000","last_fullsized":"2024-09-21T07:01:04.843915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:41.462449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843779+0000","last_change":"2024-09-21T07:01:03.777959+0000","last_active":"2024-09-21T07:01:04.843779+0000","last_peered":"2024-09-21T07:01:04.843779+0000","last_clean":"2024-09-21T07:01:04.843779+0000","last_became_active":"2024-09-21T07:01:03.777648+0000","last_became_peered":"2024-09-21T07:01:03.777648+0000","last_unstale":"2024-09-21T07:01:04.843779+0000","last_undegraded":"2024-09-21T07:01:04.843779+0000","last_fullsized":"2024-09-21T07:01:04.843779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:11.993232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843470+0000","last_change":"2024-09-21T07:01:02.792375+0000","last_active":"2024-09-21T07:01:04.843470+0000","last_peered":"2024-09-21T07:01:04.843470+0000","last_clean":"2024-09-21T07:01:04.843470+0000","last_became_active":"2024-09-21T07:01:02.792035+0000","last_became_peered":"2024-09-21T07:01:02.792035+0000","last_unstale":"2024-09-21T07:01:04.843470+0000","last_undegraded":"2024-09-21T07:01:04.843470+0000","last_fullsized":"2024-09-21T07:01:04.843470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:38.186488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843785+0000","last_change":"2024-09-21T07:01:03.788441+0000","last_active":"2024-09-21T07:01:04.843785+0000","last_peered":"2024-09-21T07:01:04.843785+0000","last_clean":"2024-09-21T07:01:04.843785+0000","last_became_active":"2024-09-21T07:01:03.788130+0000","last_became_peered":"2024-09-21T07:01:03.788130+0000","last_unstale":"2024-09-21T07:01:04.843785+0000","last_undegraded":"2024-09-21T07:01:04.843785+0000","last_fullsized":"2024-09-21T07:01:04.843785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:13.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768417+0000","last_change":"2024-09-21T07:01:02.776793+0000","last_active":"2024-09-21T07:01:04.768417+0000","last_peered":"2024-09-21T07:01:04.768417+0000","last_clean":"2024-09-21T07:01:04.768417+0000","last_became_active":"2024-09-21T07:01:02.775460+0000","last_became_peered":"2024-09-21T07:01:02.775460+0000","last_unstale":"2024-09-21T07:01:04.768417+0000","last_undegraded":"2024-09-21T07:01:04.768417+0000","last_fullsized":"2024-09-21T07:01:04.768417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:05.467271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768307+0000","last_change":"2024-09-21T07:01:03.791274+0000","last_active":"2024-09-21T07:01:04.768307+0000","last_peered":"2024-09-21T07:01:04.768307+0000","last_clean":"2024-09-21T07:01:04.768307+0000","last_became_active":"2024-09-21T07:01:03.790995+0000","last_became_peered":"2024-09-21T07:01:03.790995+0000","last_unstale":"2024-09-21T07:01:04.768307+0000","last_undegraded":"2024-09-21T07:01:04.768307+0000","last_fullsized":"2024-09-21T07:01:04.768307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:52.515976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843395+0000","last_change":"2024-09-21T07:01:02.781006+0000","last_active":"2024-09-21T07:01:04.843395+0000","last_peered":"2024-09-21T07:01:04.843395+0000","last_clean":"2024-09-21T07:01:04.843395+0000","last_became_active":"2024-09-21T07:01:02.780061+0000","last_became_peered":"2024-09-21T07:01:02.780061+0000","last_unstale":"2024-09-21T07:01:04.843395+0000","last_undegraded":"2024-09-21T07:01:04.843395+0000","last_fullsized":"2024-09-21T07:01:04.843395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:26.121246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844799+0000","last_change":"2024-09-21T07:01:03.790603+0000","last_active":"2024-09-21T07:01:04.844799+0000","last_peered":"2024-09-21T07:01:04.844799+0000","last_clean":"2024-09-21T07:01:04.844799+0000","last_became_active":"2024-09-21T07:01:03.790244+0000","last_became_peered":"2024-09-21T07:01:03.790244+0000","last_unstale":"2024-09-21T07:01:04.844799+0000","last_undegraded":"2024-09-21T07:01:04.844799+0000","last_fullsized":"2024-09-21T07:01:04.844799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:07.386079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843927+0000","last_change":"2024-09-21T07:01:02.790264+0000","last_active":"2024-09-21T07:01:04.843927+0000","last_peered":"2024-09-21T07:01:04.843927+0000","last_clean":"2024-09-21T07:01:04.843927+0000","last_became_active":"2024-09-21T07:01:02.789872+0000","last_became_peered":"2024-09-21T07:01:02.789872+0000","last_unstale":"2024-09-21T07:01:04.843927+0000","last_undegraded":"2024-09-21T07:01:04.843927+0000","last_fullsized":"2024-09-21T07:01:04.843927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.976446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843758+0000","last_change":"2024-09-21T07:01:03.781029+0000","last_active":"2024-09-21T07:01:04.843758+0000","last_peered":"2024-09-21T07:01:04.843758+0000","last_clean":"2024-09-21T07:01:04.843758+0000","last_became_active":"2024-09-21T07:01:03.780695+0000","last_became_peered":"2024-09-21T07:01:03.780695+0000","last_unstale":"2024-09-21T07:01:04.843758+0000","last_undegraded":"2024-09-21T07:01:04.843758+0000","last_fullsized":"2024-09-21T07:01:04.843758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:24.208627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844717+0000","last_change":"2024-09-21T07:01:02.781328+0000","last_active":"2024-09-21T07:01:04.844717+0000","last_peered":"2024-09-21T07:01:04.844717+0000","last_clean":"2024-09-21T07:01:04.844717+0000","last_became_active":"2024-09-21T07:01:02.780299+0000","last_became_peered":"2024-09-21T07:01:02.780299+0000","last_unstale":"2024-09-21T07:01:04.844717+0000","last_undegraded":"2024-09-21T07:01:04.844717+0000","last_fullsized":"2024-09-21T07:01:04.844717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:56.729028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844953+0000","last_change":"2024-09-21T07:01:03.795504+0000","last_active":"2024-09-21T07:01:04.844953+0000","last_peered":"2024-09-21T07:01:04.844953+0000","last_clean":"2024-09-21T07:01:04.844953+0000","last_became_active":"2024-09-21T07:01:03.795137+0000","last_became_peered":"2024-09-21T07:01:03.795137+0000","last_unstale":"2024-09-21T07:01:04.844953+0000","last_undegraded":"2024-09-21T07:01:04.844953+0000","last_fullsized":"2024-09-21T07:01:04.844953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:35.892752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844355+0000","last_change":"2024-09-21T07:01:02.778586+0000","last_active":"2024-09-21T07:01:04.844355+0000","last_peered":"2024-09-21T07:01:04.844355+0000","last_clean":"2024-09-21T07:01:04.844355+0000","last_became_active":"2024-09-21T07:01:02.778221+0000","last_became_peered":"2024-09-21T07:01:02.778221+0000","last_unstale":"2024-09-21T07:01:04.844355+0000","last_undegraded":"2024-09-21T07:01:04.844355+0000","last_fullsized":"2024-09-21T07:01:04.844355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:31.170615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767423+0000","last_change":"2024-09-21T07:01:03.779595+0000","last_active":"2024-09-21T07:01:04.767423+0000","last_peered":"2024-09-21T07:01:04.767423+0000","last_clean":"2024-09-21T07:01:04.767423+0000","last_became_active":"2024-09-21T07:01:03.778855+0000","last_became_peered":"2024-09-21T07:01:03.778855+0000","last_unstale":"2024-09-21T07:01:04.767423+0000","last_undegraded":"2024-09-21T07:01:04.767423+0000","last_fullsized":"2024-09-21T07:01:04.767423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:43.811241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844675+0000","last_change":"2024-09-21T07:01:02.790214+0000","last_active":"2024-09-21T07:01:04.844675+0000","last_peered":"2024-09-21T07:01:04.844675+0000","last_clean":"2024-09-21T07:01:04.844675+0000","last_became_active":"2024-09-21T07:01:02.789887+0000","last_became_peered":"2024-09-21T07:01:02.789887+0000","last_unstale":"2024-09-21T07:01:04.844675+0000","last_undegraded":"2024-09-21T07:01:04.844675+0000","last_fullsized":"2024-09-21T07:01:04.844675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:51.510464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769347+0000","last_change":"2024-09-21T07:01:03.788793+0000","last_active":"2024-09-21T07:01:04.769347+0000","last_peered":"2024-09-21T07:01:04.769347+0000","last_clean":"2024-09-21T07:01:04.769347+0000","last_became_active":"2024-09-21T07:01:03.788335+0000","last_became_peered":"2024-09-21T07:01:03.788335+0000","last_unstale":"2024-09-21T07:01:04.769347+0000","last_undegraded":"2024-09-21T07:01:04.769347+0000","last_fullsized":"2024-09-21T07:01:04.769347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:30.201487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844153+0000","last_change":"2024-09-21T07:01:02.777740+0000","last_active":"2024-09-21T07:01:04.844153+0000","last_peered":"2024-09-21T07:01:04.844153+0000","last_clean":"2024-09-21T07:01:04.844153+0000","last_became_active":"2024-09-21T07:01:02.777294+0000","last_became_peered":"2024-09-21T07:01:02.777294+0000","last_unstale":"2024-09-21T07:01:04.844153+0000","last_undegraded":"2024-09-21T07:01:04.844153+0000","last_fullsized":"2024-09-21T07:01:04.844153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:44.480439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768469+0000","last_change":"2024-09-21T07:01:03.799576+0000","last_active":"2024-09-21T07:01:04.768469+0000","last_peered":"2024-09-21T07:01:04.768469+0000","last_clean":"2024-09-21T07:01:04.768469+0000","last_became_active":"2024-09-21T07:01:03.799115+0000","last_became_peered":"2024-09-21T07:01:03.799115+0000","last_unstale":"2024-09-21T07:01:04.768469+0000","last_undegraded":"2024-09-21T07:01:04.768469+0000","last_fullsized":"2024-09-21T07:01:04.768469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:08.030021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843373+0000","last_change":"2024-09-21T07:01:02.792247+0000","last_active":"2024-09-21T07:01:04.843373+0000","last_peered":"2024-09-21T07:01:04.843373+0000","last_clean":"2024-09-21T07:01:04.843373+0000","last_became_active":"2024-09-21T07:01:02.791859+0000","last_became_peered":"2024-09-21T07:01:02.791859+0000","last_unstale":"2024-09-21T07:01:04.843373+0000","last_undegraded":"2024-09-21T07:01:04.843373+0000","last_fullsized":"2024-09-21T07:01:04.843373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:51.510464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843787+0000","last_change":"2024-09-21T07:01:03.782839+0000","last_active":"2024-09-21T07:01:04.843787+0000","last_peered":"2024-09-21T07:01:04.843787+0000","last_clean":"2024-09-21T07:01:04.843787+0000","last_became_active":"2024-09-21T07:01:03.782446+0000","last_became_peered":"2024-09-21T07:01:03.782446+0000","last_unstale":"2024-09-21T07:01:04.843787+0000","last_undegraded":"2024-09-21T07:01:04.843787+0000","last_fullsized":"2024-09-21T07:01:04.843787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:29.430348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768233+0000","last_change":"2024-09-21T07:01:02.776526+0000","last_active":"2024-09-21T07:01:04.768233+0000","last_peered":"2024-09-21T07:01:04.768233+0000","last_clean":"2024-09-21T07:01:04.768233+0000","last_became_active":"2024-09-21T07:01:02.774543+0000","last_became_peered":"2024-09-21T07:01:02.774543+0000","last_unstale":"2024-09-21T07:01:04.768233+0000","last_undegraded":"2024-09-21T07:01:04.768233+0000","last_fullsized":"2024-09-21T07:01:04.768233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:46.596779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767690+0000","last_change":"2024-09-21T07:01:03.788278+0000","last_active":"2024-09-21T07:01:04.767690+0000","last_peered":"2024-09-21T07:01:04.767690+0000","last_clean":"2024-09-21T07:01:04.767690+0000","last_became_active":"2024-09-21T07:01:03.787728+0000","last_became_peered":"2024-09-21T07:01:03.787728+0000","last_unstale":"2024-09-21T07:01:04.767690+0000","last_undegraded":"2024-09-21T07:01:04.767690+0000","last_fullsized":"2024-09-21T07:01:04.767690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:04.194032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843977+0000","last_change":"2024-09-21T07:01:02.779208+0000","last_active":"2024-09-21T07:01:04.843977+0000","last_peered":"2024-09-21T07:01:04.843977+0000","last_clean":"2024-09-21T07:01:04.843977+0000","last_became_active":"2024-09-21T07:01:02.778011+0000","last_became_peered":"2024-09-21T07:01:02.778011+0000","last_unstale":"2024-09-21T07:01:04.843977+0000","last_undegraded":"2024-09-21T07:01:04.843977+0000","last_fullsized":"2024-09-21T07:01:04.843977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:04.375217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767896+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:01:04.767896+0000","last_peered":"2024-09-21T07:01:04.767896+0000","last_clean":"2024-09-21T07:01:04.767896+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:01:04.767896+0000","last_undegraded":"2024-09-21T07:01:04.767896+0000","last_fullsized":"2024-09-21T07:01:04.767896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":133486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,11],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":364544,"data_stored":135076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":730714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":368640,"data_stored":134240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":133498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":730202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":356352,"data_stored":133554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":141398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:01:12.369 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:01:12.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.500+0000 7f786daf2640 1 -- 172.21.15.63:0/1461619319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7854004d40 msgr2=0x7f7854005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:12.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.500+0000 7f786daf2640 1 --2- 172.21.15.63:0/1461619319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7854004d40 0x7f7854005150 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7868069560 tx=0x7f7854005830 comp rx=0 tx=0).stop 2024-09-21T07:01:12.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.500+0000 7f7867fff640 1 -- 172.21.15.63:0/1461619319 reap_dead start 2024-09-21T07:01:12.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.500+0000 7f786daf2640 1 -- 172.21.15.63:0/1461619319 shutdown_connections 2024-09-21T07:01:12.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.500+0000 7f786daf2640 1 -- 172.21.15.63:0/1461619319 >> 172.21.15.63:0/1461619319 conn(0x7f78680b2790 msgr2=0x7f78680b2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:12.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.500+0000 7f786daf2640 1 -- 172.21.15.63:0/1461619319 shutdown_connections 2024-09-21T07:01:12.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.500+0000 7f786daf2640 1 -- 172.21.15.63:0/1461619319 wait complete. 2024-09-21T07:01:12.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.502+0000 7f786daf2640 1 Processor -- start 2024-09-21T07:01:12.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.502+0000 7f786daf2640 1 -- start start 2024-09-21T07:01:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.503+0000 7f786daf2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854004d40 0x7f786814a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.503+0000 7f786daf2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f786814d390 0x7f786814d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f786daf2640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f786814dce0 0x7f786813e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f786daf2640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f78680b3e20 con 0x7f786814d390 2024-09-21T07:01:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f786daf2640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f78680b3ca0 con 0x7f7854004d40 2024-09-21T07:01:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f786daf2640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f78680b3fa0 con 0x7f786814dce0 2024-09-21T07:01:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f7866ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f786814d390 0x7f786814d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f7866ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f786814d390 0x7f786814d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51498/0 (socket says 172.21.15.63:51498) 2024-09-21T07:01:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f7866ffd640 1 -- 172.21.15.63:0/1940094356 learned_addr learned my addr 172.21.15.63:0/1940094356 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f78677fe640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854004d40 0x7f786814a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f7867fff640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f786814dce0 0x7f786813e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f7866ffd640 1 -- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f786814dce0 msgr2=0x7f786813e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:12.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f7866ffd640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f786814dce0 0x7f786813e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f7866ffd640 1 -- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854004d40 msgr2=0x7f786814a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f7866ffd640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854004d40 0x7f786814a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f7866ffd640 1 -- 172.21.15.63:0/1940094356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78681f5f80 con 0x7f786814d390 2024-09-21T07:01:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f7867fff640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f786814dce0 0x7f786813e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:01:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f7866ffd640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f786814d390 0x7f786814d7a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7850011c30 tx=0x7f785000e780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f785ffff640 1 -- 172.21.15.63:0/1940094356 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7850005020 con 0x7f786814d390 2024-09-21T07:01:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f785ffff640 1 -- 172.21.15.63:0/1940094356 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78500051c0 con 0x7f786814d390 2024-09-21T07:01:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f786daf2640 1 -- 172.21.15.63:0/1940094356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78681f6260 con 0x7f786814d390 2024-09-21T07:01:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f785ffff640 1 -- 172.21.15.63:0/1940094356 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78500055f0 con 0x7f786814d390 2024-09-21T07:01:12.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.504+0000 7f786daf2640 1 -- 172.21.15.63:0/1940094356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f786814e0f0 con 0x7f786814d390 2024-09-21T07:01:12.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.505+0000 7f786daf2640 1 -- 172.21.15.63:0/1940094356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78681f5cf0 con 0x7f786814d390 2024-09-21T07:01:12.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.506+0000 7f785ffff640 1 -- 172.21.15.63:0/1940094356 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78500047a0 con 0x7f786814d390 2024-09-21T07:01:12.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.507+0000 7f785ffff640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7848078bc0 0x7f784807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:12.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.507+0000 7f785ffff640 1 -- 172.21.15.63:0/1940094356 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f785009d9a0 con 0x7f786814d390 2024-09-21T07:01:12.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.507+0000 7f78677fe640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7848078bc0 0x7f784807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:12.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.508+0000 7f78677fe640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7848078bc0 0x7f784807b0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7858009ba0 tx=0x7f7858005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:12.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.512+0000 7f785ffff640 1 -- 172.21.15.63:0/1940094356 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f7850065f00 con 0x7f786814d390 2024-09-21T07:01:12.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.696+0000 7f786daf2640 1 -- 172.21.15.63:0/1940094356 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78680b3510 con 0x7f7848078bc0 2024-09-21T07:01:12.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.701+0000 7f785ffff640 1 -- 172.21.15.63:0/1940094356 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251832 (secure 0 0 0) 0x7f78680b3510 con 0x7f7848078bc0 2024-09-21T07:01:12.705 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:12.706 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:01:12.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.704+0000 7f786daf2640 1 -- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7848078bc0 msgr2=0x7f784807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:12.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.704+0000 7f786daf2640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7848078bc0 0x7f784807b0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7858009ba0 tx=0x7f7858005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:12.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.704+0000 7f786daf2640 1 -- 172.21.15.63:0/1940094356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f786814d390 msgr2=0x7f786814d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:12.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.704+0000 7f786daf2640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f786814d390 0x7f786814d7a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7850011c30 tx=0x7f785000e780 comp rx=0 tx=0).stop 2024-09-21T07:01:12.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.704+0000 7f786daf2640 1 -- 172.21.15.63:0/1940094356 shutdown_connections 2024-09-21T07:01:12.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.704+0000 7f786daf2640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7848078bc0 0x7f784807b0d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:12.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.704+0000 7f786daf2640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f786814dce0 0x7f786813e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:12.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.704+0000 7f786daf2640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f786814d390 0x7f786814d7a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:12.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.704+0000 7f786daf2640 1 --2- 172.21.15.63:0/1940094356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7854004d40 0x7f786814a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:12.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.704+0000 7f786daf2640 1 -- 172.21.15.63:0/1940094356 >> 172.21.15.63:0/1940094356 conn(0x7f78680b2790 msgr2=0x7f78680cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:12.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.704+0000 7f786daf2640 1 -- 172.21.15.63:0/1940094356 shutdown_connections 2024-09-21T07:01:12.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.704+0000 7f786daf2640 1 -- 172.21.15.63:0/1940094356 wait complete. 2024-09-21T07:01:12.717 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-21T07:01:12.609710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220328,"kb_used_data":4072,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754392,"statfs":{"total":773094113280,"available":772868497408,"internally_reserved":0,"allocated":4169728,"data_stored":2303668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.842270"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844066+0000","last_change":"2024-09-21T07:01:03.794142+0000","last_active":"2024-09-21T07:01:04.844066+0000","last_peered":"2024-09-21T07:01:04.844066+0000","last_clean":"2024-09-21T07:01:04.844066+0000","last_became_active":"2024-09-21T07:01:03.790316+0000","last_became_peered":"2024-09-21T07:01:03.790316+0000","last_unstale":"2024-09-21T07:01:04.844066+0000","last_undegraded":"2024-09-21T07:01:04.844066+0000","last_fullsized":"2024-09-21T07:01:04.844066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:19.787933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844566+0000","last_change":"2024-09-21T07:01:03.791660+0000","last_active":"2024-09-21T07:01:04.844566+0000","last_peered":"2024-09-21T07:01:04.844566+0000","last_clean":"2024-09-21T07:01:04.844566+0000","last_became_active":"2024-09-21T07:01:03.790741+0000","last_became_peered":"2024-09-21T07:01:03.790741+0000","last_unstale":"2024-09-21T07:01:04.844566+0000","last_undegraded":"2024-09-21T07:01:04.844566+0000","last_fullsized":"2024-09-21T07:01:04.844566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.262768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768560+0000","last_change":"2024-09-21T07:01:03.792492+0000","last_active":"2024-09-21T07:01:04.768560+0000","last_peered":"2024-09-21T07:01:04.768560+0000","last_clean":"2024-09-21T07:01:04.768560+0000","last_became_active":"2024-09-21T07:01:03.792164+0000","last_became_peered":"2024-09-21T07:01:03.792164+0000","last_unstale":"2024-09-21T07:01:04.768560+0000","last_undegraded":"2024-09-21T07:01:04.768560+0000","last_fullsized":"2024-09-21T07:01:04.768560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:38.201057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769210+0000","last_change":"2024-09-21T07:01:03.799627+0000","last_active":"2024-09-21T07:01:04.769210+0000","last_peered":"2024-09-21T07:01:04.769210+0000","last_clean":"2024-09-21T07:01:04.769210+0000","last_became_active":"2024-09-21T07:01:03.798990+0000","last_became_peered":"2024-09-21T07:01:03.798990+0000","last_unstale":"2024-09-21T07:01:04.769210+0000","last_undegraded":"2024-09-21T07:01:04.769210+0000","last_fullsized":"2024-09-21T07:01:04.769210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:01:31.551004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843541+0000","last_change":"2024-09-21T07:01:03.775605+0000","last_active":"2024-09-21T07:01:04.843541+0000","last_peered":"2024-09-21T07:01:04.843541+0000","last_clean":"2024-09-21T07:01:04.843541+0000","last_became_active":"2024-09-21T07:01:03.775096+0000","last_became_peered":"2024-09-21T07:01:03.775096+0000","last_unstale":"2024-09-21T07:01:04.843541+0000","last_undegraded":"2024-09-21T07:01:04.843541+0000","last_fullsized":"2024-09-21T07:01:04.843541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:23.836413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844759+0000","last_change":"2024-09-21T07:01:03.801253+0000","last_active":"2024-09-21T07:01:04.844759+0000","last_peered":"2024-09-21T07:01:04.844759+0000","last_clean":"2024-09-21T07:01:04.844759+0000","last_became_active":"2024-09-21T07:01:03.800920+0000","last_became_peered":"2024-09-21T07:01:03.800920+0000","last_unstale":"2024-09-21T07:01:04.844759+0000","last_undegraded":"2024-09-21T07:01:04.844759+0000","last_fullsized":"2024-09-21T07:01:04.844759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:42.751536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843408+0000","last_change":"2024-09-21T07:01:03.795428+0000","last_active":"2024-09-21T07:01:04.843408+0000","last_peered":"2024-09-21T07:01:04.843408+0000","last_clean":"2024-09-21T07:01:04.843408+0000","last_became_active":"2024-09-21T07:01:03.795098+0000","last_became_peered":"2024-09-21T07:01:03.795098+0000","last_unstale":"2024-09-21T07:01:04.843408+0000","last_undegraded":"2024-09-21T07:01:04.843408+0000","last_fullsized":"2024-09-21T07:01:04.843408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843685+0000","last_change":"2024-09-21T07:01:03.795965+0000","last_active":"2024-09-21T07:01:04.843685+0000","last_peered":"2024-09-21T07:01:04.843685+0000","last_clean":"2024-09-21T07:01:04.843685+0000","last_became_active":"2024-09-21T07:01:03.795485+0000","last_became_peered":"2024-09-21T07:01:03.795485+0000","last_unstale":"2024-09-21T07:01:04.843685+0000","last_undegraded":"2024-09-21T07:01:04.843685+0000","last_fullsized":"2024-09-21T07:01:04.843685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:45.129827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768692+0000","last_change":"2024-09-21T07:01:03.797379+0000","last_active":"2024-09-21T07:01:04.768692+0000","last_peered":"2024-09-21T07:01:04.768692+0000","last_clean":"2024-09-21T07:01:04.768692+0000","last_became_active":"2024-09-21T07:01:03.797038+0000","last_became_peered":"2024-09-21T07:01:03.797038+0000","last_unstale":"2024-09-21T07:01:04.768692+0000","last_undegraded":"2024-09-21T07:01:04.768692+0000","last_fullsized":"2024-09-21T07:01:04.768692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:27.981958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769463+0000","last_change":"2024-09-21T07:01:03.793354+0000","last_active":"2024-09-21T07:01:04.769463+0000","last_peered":"2024-09-21T07:01:04.769463+0000","last_clean":"2024-09-21T07:01:04.769463+0000","last_became_active":"2024-09-21T07:01:03.792998+0000","last_became_peered":"2024-09-21T07:01:03.792998+0000","last_unstale":"2024-09-21T07:01:04.769463+0000","last_undegraded":"2024-09-21T07:01:04.769463+0000","last_fullsized":"2024-09-21T07:01:04.769463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:17:26.579640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843680+0000","last_change":"2024-09-21T07:01:03.797615+0000","last_active":"2024-09-21T07:01:04.843680+0000","last_peered":"2024-09-21T07:01:04.843680+0000","last_clean":"2024-09-21T07:01:04.843680+0000","last_became_active":"2024-09-21T07:01:03.796962+0000","last_became_peered":"2024-09-21T07:01:03.796962+0000","last_unstale":"2024-09-21T07:01:04.843680+0000","last_undegraded":"2024-09-21T07:01:04.843680+0000","last_fullsized":"2024-09-21T07:01:04.843680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:29.202843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768150+0000","last_change":"2024-09-21T07:01:03.788053+0000","last_active":"2024-09-21T07:01:04.768150+0000","last_peered":"2024-09-21T07:01:04.768150+0000","last_clean":"2024-09-21T07:01:04.768150+0000","last_became_active":"2024-09-21T07:01:03.787728+0000","last_became_peered":"2024-09-21T07:01:03.787728+0000","last_unstale":"2024-09-21T07:01:04.768150+0000","last_undegraded":"2024-09-21T07:01:04.768150+0000","last_fullsized":"2024-09-21T07:01:04.768150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:44.719032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844461+0000","last_change":"2024-09-21T07:01:03.792564+0000","last_active":"2024-09-21T07:01:04.844461+0000","last_peered":"2024-09-21T07:01:04.844461+0000","last_clean":"2024-09-21T07:01:04.844461+0000","last_became_active":"2024-09-21T07:01:03.791629+0000","last_became_peered":"2024-09-21T07:01:03.791629+0000","last_unstale":"2024-09-21T07:01:04.844461+0000","last_undegraded":"2024-09-21T07:01:04.844461+0000","last_fullsized":"2024-09-21T07:01:04.844461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:58.610632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768644+0000","last_change":"2024-09-21T07:01:03.791933+0000","last_active":"2024-09-21T07:01:04.768644+0000","last_peered":"2024-09-21T07:01:04.768644+0000","last_clean":"2024-09-21T07:01:04.768644+0000","last_became_active":"2024-09-21T07:01:03.791599+0000","last_became_peered":"2024-09-21T07:01:03.791599+0000","last_unstale":"2024-09-21T07:01:04.768644+0000","last_undegraded":"2024-09-21T07:01:04.768644+0000","last_fullsized":"2024-09-21T07:01:04.768644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:10.931859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767157+0000","last_change":"2024-09-21T07:01:03.801933+0000","last_active":"2024-09-21T07:01:04.767157+0000","last_peered":"2024-09-21T07:01:04.767157+0000","last_clean":"2024-09-21T07:01:04.767157+0000","last_became_active":"2024-09-21T07:01:03.801563+0000","last_became_peered":"2024-09-21T07:01:03.801563+0000","last_unstale":"2024-09-21T07:01:04.767157+0000","last_undegraded":"2024-09-21T07:01:04.767157+0000","last_fullsized":"2024-09-21T07:01:04.767157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:34.894160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767121+0000","last_change":"2024-09-21T07:01:03.787523+0000","last_active":"2024-09-21T07:01:04.767121+0000","last_peered":"2024-09-21T07:01:04.767121+0000","last_clean":"2024-09-21T07:01:04.767121+0000","last_became_active":"2024-09-21T07:01:03.786731+0000","last_became_peered":"2024-09-21T07:01:03.786731+0000","last_unstale":"2024-09-21T07:01:04.767121+0000","last_undegraded":"2024-09-21T07:01:04.767121+0000","last_fullsized":"2024-09-21T07:01:04.767121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:11.993232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843403+0000","last_change":"2024-09-21T07:01:03.799976+0000","last_active":"2024-09-21T07:01:04.843403+0000","last_peered":"2024-09-21T07:01:04.843403+0000","last_clean":"2024-09-21T07:01:04.843403+0000","last_became_active":"2024-09-21T07:01:03.799425+0000","last_became_peered":"2024-09-21T07:01:03.799425+0000","last_unstale":"2024-09-21T07:01:04.843403+0000","last_undegraded":"2024-09-21T07:01:04.843403+0000","last_fullsized":"2024-09-21T07:01:04.843403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:37.275079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844401+0000","last_change":"2024-09-21T07:01:03.781832+0000","last_active":"2024-09-21T07:01:04.844401+0000","last_peered":"2024-09-21T07:01:04.844401+0000","last_clean":"2024-09-21T07:01:04.844401+0000","last_became_active":"2024-09-21T07:01:03.779709+0000","last_became_peered":"2024-09-21T07:01:03.779709+0000","last_unstale":"2024-09-21T07:01:04.844401+0000","last_undegraded":"2024-09-21T07:01:04.844401+0000","last_fullsized":"2024-09-21T07:01:04.844401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:04.995003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844689+0000","last_change":"2024-09-21T07:01:03.788320+0000","last_active":"2024-09-21T07:01:04.844689+0000","last_peered":"2024-09-21T07:01:04.844689+0000","last_clean":"2024-09-21T07:01:04.844689+0000","last_became_active":"2024-09-21T07:01:03.787978+0000","last_became_peered":"2024-09-21T07:01:03.787978+0000","last_unstale":"2024-09-21T07:01:04.844689+0000","last_undegraded":"2024-09-21T07:01:04.844689+0000","last_fullsized":"2024-09-21T07:01:04.844689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:08:18.875542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844064+0000","last_change":"2024-09-21T07:01:03.792145+0000","last_active":"2024-09-21T07:01:04.844064+0000","last_peered":"2024-09-21T07:01:04.844064+0000","last_clean":"2024-09-21T07:01:04.844064+0000","last_became_active":"2024-09-21T07:01:03.791766+0000","last_became_peered":"2024-09-21T07:01:03.791766+0000","last_unstale":"2024-09-21T07:01:04.844064+0000","last_undegraded":"2024-09-21T07:01:04.844064+0000","last_fullsized":"2024-09-21T07:01:04.844064+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:45.001116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767414+0000","last_change":"2024-09-21T07:01:03.788762+0000","last_active":"2024-09-21T07:01:04.767414+0000","last_peered":"2024-09-21T07:01:04.767414+0000","last_clean":"2024-09-21T07:01:04.767414+0000","last_became_active":"2024-09-21T07:01:03.788372+0000","last_became_peered":"2024-09-21T07:01:03.788372+0000","last_unstale":"2024-09-21T07:01:04.767414+0000","last_undegraded":"2024-09-21T07:01:04.767414+0000","last_fullsized":"2024-09-21T07:01:04.767414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:19.787933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843211+0000","last_change":"2024-09-21T07:01:03.799507+0000","last_active":"2024-09-21T07:01:04.843211+0000","last_peered":"2024-09-21T07:01:04.843211+0000","last_clean":"2024-09-21T07:01:04.843211+0000","last_became_active":"2024-09-21T07:01:03.798713+0000","last_became_peered":"2024-09-21T07:01:03.798713+0000","last_unstale":"2024-09-21T07:01:04.843211+0000","last_undegraded":"2024-09-21T07:01:04.843211+0000","last_fullsized":"2024-09-21T07:01:04.843211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:42.573263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843765+0000","last_change":"2024-09-21T07:01:03.781265+0000","last_active":"2024-09-21T07:01:04.843765+0000","last_peered":"2024-09-21T07:01:04.843765+0000","last_clean":"2024-09-21T07:01:04.843765+0000","last_became_active":"2024-09-21T07:01:03.780969+0000","last_became_peered":"2024-09-21T07:01:03.780969+0000","last_unstale":"2024-09-21T07:01:04.843765+0000","last_undegraded":"2024-09-21T07:01:04.843765+0000","last_fullsized":"2024-09-21T07:01:04.843765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:59.851233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843141+0000","last_change":"2024-09-21T07:01:03.799128+0000","last_active":"2024-09-21T07:01:04.843141+0000","last_peered":"2024-09-21T07:01:04.843141+0000","last_clean":"2024-09-21T07:01:04.843141+0000","last_became_active":"2024-09-21T07:01:03.798706+0000","last_became_peered":"2024-09-21T07:01:03.798706+0000","last_unstale":"2024-09-21T07:01:04.843141+0000","last_undegraded":"2024-09-21T07:01:04.843141+0000","last_fullsized":"2024-09-21T07:01:04.843141+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:56.371767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769254+0000","last_change":"2024-09-21T07:01:03.800165+0000","last_active":"2024-09-21T07:01:04.769254+0000","last_peered":"2024-09-21T07:01:04.769254+0000","last_clean":"2024-09-21T07:01:04.769254+0000","last_became_active":"2024-09-21T07:01:03.799818+0000","last_became_peered":"2024-09-21T07:01:03.799818+0000","last_unstale":"2024-09-21T07:01:04.769254+0000","last_undegraded":"2024-09-21T07:01:04.769254+0000","last_fullsized":"2024-09-21T07:01:04.769254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:20:03.393628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769248+0000","last_change":"2024-09-21T07:01:03.791524+0000","last_active":"2024-09-21T07:01:04.769248+0000","last_peered":"2024-09-21T07:01:04.769248+0000","last_clean":"2024-09-21T07:01:04.769248+0000","last_became_active":"2024-09-21T07:01:03.791175+0000","last_became_peered":"2024-09-21T07:01:03.791175+0000","last_unstale":"2024-09-21T07:01:04.769248+0000","last_undegraded":"2024-09-21T07:01:04.769248+0000","last_fullsized":"2024-09-21T07:01:04.769248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:41.064395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844561+0000","last_change":"2024-09-21T07:01:03.789643+0000","last_active":"2024-09-21T07:01:04.844561+0000","last_peered":"2024-09-21T07:01:04.844561+0000","last_clean":"2024-09-21T07:01:04.844561+0000","last_became_active":"2024-09-21T07:01:03.789249+0000","last_became_peered":"2024-09-21T07:01:03.789249+0000","last_unstale":"2024-09-21T07:01:04.844561+0000","last_undegraded":"2024-09-21T07:01:04.844561+0000","last_fullsized":"2024-09-21T07:01:04.844561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:24.747636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844048+0000","last_change":"2024-09-21T07:01:03.793850+0000","last_active":"2024-09-21T07:01:04.844048+0000","last_peered":"2024-09-21T07:01:04.844048+0000","last_clean":"2024-09-21T07:01:04.844048+0000","last_became_active":"2024-09-21T07:01:03.790220+0000","last_became_peered":"2024-09-21T07:01:03.790220+0000","last_unstale":"2024-09-21T07:01:04.844048+0000","last_undegraded":"2024-09-21T07:01:04.844048+0000","last_fullsized":"2024-09-21T07:01:04.844048+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.262768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767762+0000","last_change":"2024-09-21T07:01:03.802120+0000","last_active":"2024-09-21T07:01:04.767762+0000","last_peered":"2024-09-21T07:01:04.767762+0000","last_clean":"2024-09-21T07:01:04.767762+0000","last_became_active":"2024-09-21T07:01:03.801699+0000","last_became_peered":"2024-09-21T07:01:03.801699+0000","last_unstale":"2024-09-21T07:01:04.767762+0000","last_undegraded":"2024-09-21T07:01:04.767762+0000","last_fullsized":"2024-09-21T07:01:04.767762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:16.741550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767176+0000","last_change":"2024-09-21T07:01:03.779994+0000","last_active":"2024-09-21T07:01:04.767176+0000","last_peered":"2024-09-21T07:01:04.767176+0000","last_clean":"2024-09-21T07:01:04.767176+0000","last_became_active":"2024-09-21T07:01:03.779267+0000","last_became_peered":"2024-09-21T07:01:03.779267+0000","last_unstale":"2024-09-21T07:01:04.767176+0000","last_undegraded":"2024-09-21T07:01:04.767176+0000","last_fullsized":"2024-09-21T07:01:04.767176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:24.747636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843248+0000","last_change":"2024-09-21T07:01:03.799390+0000","last_active":"2024-09-21T07:01:04.843248+0000","last_peered":"2024-09-21T07:01:04.843248+0000","last_clean":"2024-09-21T07:01:04.843248+0000","last_became_active":"2024-09-21T07:01:03.799078+0000","last_became_peered":"2024-09-21T07:01:03.799078+0000","last_unstale":"2024-09-21T07:01:04.843248+0000","last_undegraded":"2024-09-21T07:01:04.843248+0000","last_fullsized":"2024-09-21T07:01:04.843248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:25:36.565399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843261+0000","last_change":"2024-09-21T07:01:03.800557+0000","last_active":"2024-09-21T07:01:04.843261+0000","last_peered":"2024-09-21T07:01:04.843261+0000","last_clean":"2024-09-21T07:01:04.843261+0000","last_became_active":"2024-09-21T07:01:03.800262+0000","last_became_peered":"2024-09-21T07:01:03.800262+0000","last_unstale":"2024-09-21T07:01:04.843261+0000","last_undegraded":"2024-09-21T07:01:04.843261+0000","last_fullsized":"2024-09-21T07:01:04.843261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:06.031208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844973+0000","last_change":"2024-09-21T07:01:03.781597+0000","last_active":"2024-09-21T07:01:04.844973+0000","last_peered":"2024-09-21T07:01:04.844973+0000","last_clean":"2024-09-21T07:01:04.844973+0000","last_became_active":"2024-09-21T07:01:03.781303+0000","last_became_peered":"2024-09-21T07:01:03.781303+0000","last_unstale":"2024-09-21T07:01:04.844973+0000","last_undegraded":"2024-09-21T07:01:04.844973+0000","last_fullsized":"2024-09-21T07:01:04.844973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:07:42.573263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843625+0000","last_change":"2024-09-21T07:01:02.778634+0000","last_active":"2024-09-21T07:01:04.843625+0000","last_peered":"2024-09-21T07:01:04.843625+0000","last_clean":"2024-09-21T07:01:04.843625+0000","last_became_active":"2024-09-21T07:01:02.778310+0000","last_became_peered":"2024-09-21T07:01:02.778310+0000","last_unstale":"2024-09-21T07:01:04.843625+0000","last_undegraded":"2024-09-21T07:01:04.843625+0000","last_fullsized":"2024-09-21T07:01:04.843625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:39.995378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844286+0000","last_change":"2024-09-21T07:01:03.801557+0000","last_active":"2024-09-21T07:01:04.844286+0000","last_peered":"2024-09-21T07:01:04.844286+0000","last_clean":"2024-09-21T07:01:04.844286+0000","last_became_active":"2024-09-21T07:01:03.801233+0000","last_became_peered":"2024-09-21T07:01:03.801233+0000","last_unstale":"2024-09-21T07:01:04.844286+0000","last_undegraded":"2024-09-21T07:01:04.844286+0000","last_fullsized":"2024-09-21T07:01:04.844286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:23:01.557172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769391+0000","last_change":"2024-09-21T07:01:02.773667+0000","last_active":"2024-09-21T07:01:04.769391+0000","last_peered":"2024-09-21T07:01:04.769391+0000","last_clean":"2024-09-21T07:01:04.769391+0000","last_became_active":"2024-09-21T07:01:02.772500+0000","last_became_peered":"2024-09-21T07:01:02.772500+0000","last_unstale":"2024-09-21T07:01:04.769391+0000","last_undegraded":"2024-09-21T07:01:04.769391+0000","last_fullsized":"2024-09-21T07:01:04.769391+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:35.712366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844178+0000","last_change":"2024-09-21T07:01:03.799022+0000","last_active":"2024-09-21T07:01:04.844178+0000","last_peered":"2024-09-21T07:01:04.844178+0000","last_clean":"2024-09-21T07:01:04.844178+0000","last_became_active":"2024-09-21T07:01:03.798589+0000","last_became_peered":"2024-09-21T07:01:03.798589+0000","last_unstale":"2024-09-21T07:01:04.844178+0000","last_undegraded":"2024-09-21T07:01:04.844178+0000","last_fullsized":"2024-09-21T07:01:04.844178+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:21.629179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.845030+0000","last_change":"2024-09-21T07:01:02.785856+0000","last_active":"2024-09-21T07:01:04.845030+0000","last_peered":"2024-09-21T07:01:04.845030+0000","last_clean":"2024-09-21T07:01:04.845030+0000","last_became_active":"2024-09-21T07:01:02.785426+0000","last_became_peered":"2024-09-21T07:01:02.785426+0000","last_unstale":"2024-09-21T07:01:04.845030+0000","last_undegraded":"2024-09-21T07:01:04.845030+0000","last_fullsized":"2024-09-21T07:01:04.845030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:21.317089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769032+0000","last_change":"2024-09-21T07:01:03.787829+0000","last_active":"2024-09-21T07:01:04.769032+0000","last_peered":"2024-09-21T07:01:04.769032+0000","last_clean":"2024-09-21T07:01:04.769032+0000","last_became_active":"2024-09-21T07:01:03.787463+0000","last_became_peered":"2024-09-21T07:01:03.787463+0000","last_unstale":"2024-09-21T07:01:04.769032+0000","last_undegraded":"2024-09-21T07:01:04.769032+0000","last_fullsized":"2024-09-21T07:01:04.769032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:03:38.992018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769363+0000","last_change":"2024-09-21T07:01:02.774070+0000","last_active":"2024-09-21T07:01:04.769363+0000","last_peered":"2024-09-21T07:01:04.769363+0000","last_clean":"2024-09-21T07:01:04.769363+0000","last_became_active":"2024-09-21T07:01:02.773750+0000","last_became_peered":"2024-09-21T07:01:02.773750+0000","last_unstale":"2024-09-21T07:01:04.769363+0000","last_undegraded":"2024-09-21T07:01:04.769363+0000","last_fullsized":"2024-09-21T07:01:04.769363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:25.293735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768173+0000","last_change":"2024-09-21T07:01:03.796538+0000","last_active":"2024-09-21T07:01:04.768173+0000","last_peered":"2024-09-21T07:01:04.768173+0000","last_clean":"2024-09-21T07:01:04.768173+0000","last_became_active":"2024-09-21T07:01:03.796196+0000","last_became_peered":"2024-09-21T07:01:03.796196+0000","last_unstale":"2024-09-21T07:01:04.768173+0000","last_undegraded":"2024-09-21T07:01:04.768173+0000","last_fullsized":"2024-09-21T07:01:04.768173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:25:33.760115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843918+0000","last_change":"2024-09-21T07:01:02.791472+0000","last_active":"2024-09-21T07:01:04.843918+0000","last_peered":"2024-09-21T07:01:04.843918+0000","last_clean":"2024-09-21T07:01:04.843918+0000","last_became_active":"2024-09-21T07:01:02.791087+0000","last_became_peered":"2024-09-21T07:01:02.791087+0000","last_unstale":"2024-09-21T07:01:04.843918+0000","last_undegraded":"2024-09-21T07:01:04.843918+0000","last_fullsized":"2024-09-21T07:01:04.843918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:37.195545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843171+0000","last_change":"2024-09-21T07:01:03.800189+0000","last_active":"2024-09-21T07:01:04.843171+0000","last_peered":"2024-09-21T07:01:04.843171+0000","last_clean":"2024-09-21T07:01:04.843171+0000","last_became_active":"2024-09-21T07:01:03.799901+0000","last_became_peered":"2024-09-21T07:01:03.799901+0000","last_unstale":"2024-09-21T07:01:04.843171+0000","last_undegraded":"2024-09-21T07:01:04.843171+0000","last_fullsized":"2024-09-21T07:01:04.843171+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:44:58.610632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843353+0000","last_change":"2024-09-21T07:01:02.786240+0000","last_active":"2024-09-21T07:01:04.843353+0000","last_peered":"2024-09-21T07:01:04.843353+0000","last_clean":"2024-09-21T07:01:04.843353+0000","last_became_active":"2024-09-21T07:01:02.785829+0000","last_became_peered":"2024-09-21T07:01:02.785829+0000","last_unstale":"2024-09-21T07:01:04.843353+0000","last_undegraded":"2024-09-21T07:01:04.843353+0000","last_fullsized":"2024-09-21T07:01:04.843353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:39:52.905472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768169+0000","last_change":"2024-09-21T07:01:03.790770+0000","last_active":"2024-09-21T07:01:04.768169+0000","last_peered":"2024-09-21T07:01:04.768169+0000","last_clean":"2024-09-21T07:01:04.768169+0000","last_became_active":"2024-09-21T07:01:03.790466+0000","last_became_peered":"2024-09-21T07:01:03.790466+0000","last_unstale":"2024-09-21T07:01:04.768169+0000","last_undegraded":"2024-09-21T07:01:04.768169+0000","last_fullsized":"2024-09-21T07:01:04.768169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:39.192000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843624+0000","last_change":"2024-09-21T07:01:02.777473+0000","last_active":"2024-09-21T07:01:04.843624+0000","last_peered":"2024-09-21T07:01:04.843624+0000","last_clean":"2024-09-21T07:01:04.843624+0000","last_became_active":"2024-09-21T07:01:02.777116+0000","last_became_peered":"2024-09-21T07:01:02.777116+0000","last_unstale":"2024-09-21T07:01:04.843624+0000","last_undegraded":"2024-09-21T07:01:04.843624+0000","last_fullsized":"2024-09-21T07:01:04.843624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:59:40.790513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768296+0000","last_change":"2024-09-21T07:01:03.782050+0000","last_active":"2024-09-21T07:01:04.768296+0000","last_peered":"2024-09-21T07:01:04.768296+0000","last_clean":"2024-09-21T07:01:04.768296+0000","last_became_active":"2024-09-21T07:01:03.781742+0000","last_became_peered":"2024-09-21T07:01:03.781742+0000","last_unstale":"2024-09-21T07:01:04.768296+0000","last_undegraded":"2024-09-21T07:01:04.768296+0000","last_fullsized":"2024-09-21T07:01:04.768296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:00.690893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843506+0000","last_change":"2024-09-21T07:01:02.783052+0000","last_active":"2024-09-21T07:01:04.843506+0000","last_peered":"2024-09-21T07:01:04.843506+0000","last_clean":"2024-09-21T07:01:04.843506+0000","last_became_active":"2024-09-21T07:01:02.782729+0000","last_became_peered":"2024-09-21T07:01:02.782729+0000","last_unstale":"2024-09-21T07:01:04.843506+0000","last_undegraded":"2024-09-21T07:01:04.843506+0000","last_fullsized":"2024-09-21T07:01:04.843506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.976446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844084+0000","last_change":"2024-09-21T07:01:03.772763+0000","last_active":"2024-09-21T07:01:04.844084+0000","last_peered":"2024-09-21T07:01:04.844084+0000","last_clean":"2024-09-21T07:01:04.844084+0000","last_became_active":"2024-09-21T07:01:03.772413+0000","last_became_peered":"2024-09-21T07:01:03.772413+0000","last_unstale":"2024-09-21T07:01:04.844084+0000","last_undegraded":"2024-09-21T07:01:04.844084+0000","last_fullsized":"2024-09-21T07:01:04.844084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:14:04.294355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844234+0000","last_change":"2024-09-21T07:01:02.780860+0000","last_active":"2024-09-21T07:01:04.844234+0000","last_peered":"2024-09-21T07:01:04.844234+0000","last_clean":"2024-09-21T07:01:04.844234+0000","last_became_active":"2024-09-21T07:01:02.780296+0000","last_became_peered":"2024-09-21T07:01:02.780296+0000","last_unstale":"2024-09-21T07:01:04.844234+0000","last_undegraded":"2024-09-21T07:01:04.844234+0000","last_fullsized":"2024-09-21T07:01:04.844234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:36.181080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769199+0000","last_change":"2024-09-21T07:01:03.793872+0000","last_active":"2024-09-21T07:01:04.769199+0000","last_peered":"2024-09-21T07:01:04.769199+0000","last_clean":"2024-09-21T07:01:04.769199+0000","last_became_active":"2024-09-21T07:01:03.793469+0000","last_became_peered":"2024-09-21T07:01:03.793469+0000","last_unstale":"2024-09-21T07:01:04.769199+0000","last_undegraded":"2024-09-21T07:01:04.769199+0000","last_fullsized":"2024-09-21T07:01:04.769199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:21:42.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844702+0000","last_change":"2024-09-21T07:01:02.781901+0000","last_active":"2024-09-21T07:01:04.844702+0000","last_peered":"2024-09-21T07:01:04.844702+0000","last_clean":"2024-09-21T07:01:04.844702+0000","last_became_active":"2024-09-21T07:01:02.781563+0000","last_became_peered":"2024-09-21T07:01:02.781563+0000","last_unstale":"2024-09-21T07:01:04.844702+0000","last_undegraded":"2024-09-21T07:01:04.844702+0000","last_fullsized":"2024-09-21T07:01:04.844702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:20.713409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769430+0000","last_change":"2024-09-21T07:01:03.798837+0000","last_active":"2024-09-21T07:01:04.769430+0000","last_peered":"2024-09-21T07:01:04.769430+0000","last_clean":"2024-09-21T07:01:04.769430+0000","last_became_active":"2024-09-21T07:01:03.798557+0000","last_became_peered":"2024-09-21T07:01:03.798557+0000","last_unstale":"2024-09-21T07:01:04.769430+0000","last_undegraded":"2024-09-21T07:01:04.769430+0000","last_fullsized":"2024-09-21T07:01:04.769430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:18:14.507038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843954+0000","last_change":"2024-09-21T07:01:02.782653+0000","last_active":"2024-09-21T07:01:04.843954+0000","last_peered":"2024-09-21T07:01:04.843954+0000","last_clean":"2024-09-21T07:01:04.843954+0000","last_became_active":"2024-09-21T07:01:02.782261+0000","last_became_peered":"2024-09-21T07:01:02.782261+0000","last_unstale":"2024-09-21T07:01:04.843954+0000","last_undegraded":"2024-09-21T07:01:04.843954+0000","last_fullsized":"2024-09-21T07:01:04.843954+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:15.736038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843335+0000","last_change":"2024-09-21T07:01:03.796498+0000","last_active":"2024-09-21T07:01:04.843335+0000","last_peered":"2024-09-21T07:01:04.843335+0000","last_clean":"2024-09-21T07:01:04.843335+0000","last_became_active":"2024-09-21T07:01:03.796169+0000","last_became_peered":"2024-09-21T07:01:03.796169+0000","last_unstale":"2024-09-21T07:01:04.843335+0000","last_undegraded":"2024-09-21T07:01:04.843335+0000","last_fullsized":"2024-09-21T07:01:04.843335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:50.551965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844229+0000","last_change":"2024-09-21T07:01:02.775824+0000","last_active":"2024-09-21T07:01:04.844229+0000","last_peered":"2024-09-21T07:01:04.844229+0000","last_clean":"2024-09-21T07:01:04.844229+0000","last_became_active":"2024-09-21T07:01:02.775228+0000","last_became_peered":"2024-09-21T07:01:02.775228+0000","last_unstale":"2024-09-21T07:01:04.844229+0000","last_undegraded":"2024-09-21T07:01:04.844229+0000","last_fullsized":"2024-09-21T07:01:04.844229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:37.195545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843771+0000","last_change":"2024-09-21T07:01:03.780446+0000","last_active":"2024-09-21T07:01:04.843771+0000","last_peered":"2024-09-21T07:01:04.843771+0000","last_clean":"2024-09-21T07:01:04.843771+0000","last_became_active":"2024-09-21T07:01:03.780180+0000","last_became_peered":"2024-09-21T07:01:03.780180+0000","last_unstale":"2024-09-21T07:01:04.843771+0000","last_undegraded":"2024-09-21T07:01:04.843771+0000","last_fullsized":"2024-09-21T07:01:04.843771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:57.734540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844036+0000","last_change":"2024-09-21T07:01:02.783777+0000","last_active":"2024-09-21T07:01:04.844036+0000","last_peered":"2024-09-21T07:01:04.844036+0000","last_clean":"2024-09-21T07:01:04.844036+0000","last_became_active":"2024-09-21T07:01:02.783438+0000","last_became_peered":"2024-09-21T07:01:02.783438+0000","last_unstale":"2024-09-21T07:01:04.844036+0000","last_undegraded":"2024-09-21T07:01:04.844036+0000","last_fullsized":"2024-09-21T07:01:04.844036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:44.480439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769199+0000","last_change":"2024-09-21T07:01:03.787869+0000","last_active":"2024-09-21T07:01:04.769199+0000","last_peered":"2024-09-21T07:01:04.769199+0000","last_clean":"2024-09-21T07:01:04.769199+0000","last_became_active":"2024-09-21T07:01:03.787492+0000","last_became_peered":"2024-09-21T07:01:03.787492+0000","last_unstale":"2024-09-21T07:01:04.769199+0000","last_undegraded":"2024-09-21T07:01:04.769199+0000","last_fullsized":"2024-09-21T07:01:04.769199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:03:49.483318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768429+0000","last_change":"2024-09-21T07:01:02.780251+0000","last_active":"2024-09-21T07:01:04.768429+0000","last_peered":"2024-09-21T07:01:04.768429+0000","last_clean":"2024-09-21T07:01:04.768429+0000","last_became_active":"2024-09-21T07:01:02.779917+0000","last_became_peered":"2024-09-21T07:01:02.779917+0000","last_unstale":"2024-09-21T07:01:04.768429+0000","last_undegraded":"2024-09-21T07:01:04.768429+0000","last_fullsized":"2024-09-21T07:01:04.768429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:08:57.090924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843383+0000","last_change":"2024-09-21T07:01:03.798215+0000","last_active":"2024-09-21T07:01:04.843383+0000","last_peered":"2024-09-21T07:01:04.843383+0000","last_clean":"2024-09-21T07:01:04.843383+0000","last_became_active":"2024-09-21T07:01:03.796516+0000","last_became_peered":"2024-09-21T07:01:03.796516+0000","last_unstale":"2024-09-21T07:01:04.843383+0000","last_undegraded":"2024-09-21T07:01:04.843383+0000","last_fullsized":"2024-09-21T07:01:04.843383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:28.466335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768049+0000","last_change":"2024-09-21T07:01:02.773936+0000","last_active":"2024-09-21T07:01:04.768049+0000","last_peered":"2024-09-21T07:01:04.768049+0000","last_clean":"2024-09-21T07:01:04.768049+0000","last_became_active":"2024-09-21T07:01:02.773244+0000","last_became_peered":"2024-09-21T07:01:02.773244+0000","last_unstale":"2024-09-21T07:01:04.768049+0000","last_undegraded":"2024-09-21T07:01:04.768049+0000","last_fullsized":"2024-09-21T07:01:04.768049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:40.459222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843741+0000","last_change":"2024-09-21T07:01:03.791099+0000","last_active":"2024-09-21T07:01:04.843741+0000","last_peered":"2024-09-21T07:01:04.843741+0000","last_clean":"2024-09-21T07:01:04.843741+0000","last_became_active":"2024-09-21T07:01:03.790772+0000","last_became_peered":"2024-09-21T07:01:03.790772+0000","last_unstale":"2024-09-21T07:01:04.843741+0000","last_undegraded":"2024-09-21T07:01:04.843741+0000","last_fullsized":"2024-09-21T07:01:04.843741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:22:33.139496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843700+0000","last_change":"2024-09-21T07:01:02.782460+0000","last_active":"2024-09-21T07:01:04.843700+0000","last_peered":"2024-09-21T07:01:04.843700+0000","last_clean":"2024-09-21T07:01:04.843700+0000","last_became_active":"2024-09-21T07:01:02.782160+0000","last_became_peered":"2024-09-21T07:01:02.782160+0000","last_unstale":"2024-09-21T07:01:04.843700+0000","last_undegraded":"2024-09-21T07:01:04.843700+0000","last_fullsized":"2024-09-21T07:01:04.843700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:28:24.532930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844055+0000","last_change":"2024-09-21T07:01:03.789639+0000","last_active":"2024-09-21T07:01:04.844055+0000","last_peered":"2024-09-21T07:01:04.844055+0000","last_clean":"2024-09-21T07:01:04.844055+0000","last_became_active":"2024-09-21T07:01:03.789329+0000","last_became_peered":"2024-09-21T07:01:03.789329+0000","last_unstale":"2024-09-21T07:01:04.844055+0000","last_undegraded":"2024-09-21T07:01:04.844055+0000","last_fullsized":"2024-09-21T07:01:04.844055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:22:28.686912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843894+0000","last_change":"2024-09-21T07:01:02.780877+0000","last_active":"2024-09-21T07:01:04.843894+0000","last_peered":"2024-09-21T07:01:04.843894+0000","last_clean":"2024-09-21T07:01:04.843894+0000","last_became_active":"2024-09-21T07:01:02.780530+0000","last_became_peered":"2024-09-21T07:01:02.780530+0000","last_unstale":"2024-09-21T07:01:04.843894+0000","last_undegraded":"2024-09-21T07:01:04.843894+0000","last_fullsized":"2024-09-21T07:01:04.843894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:35:28.933785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768917+0000","last_change":"2024-09-21T07:01:03.790197+0000","last_active":"2024-09-21T07:01:04.768917+0000","last_peered":"2024-09-21T07:01:04.768917+0000","last_clean":"2024-09-21T07:01:04.768917+0000","last_became_active":"2024-09-21T07:01:03.789769+0000","last_became_peered":"2024-09-21T07:01:03.789769+0000","last_unstale":"2024-09-21T07:01:04.768917+0000","last_undegraded":"2024-09-21T07:01:04.768917+0000","last_fullsized":"2024-09-21T07:01:04.768917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:32.176127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844415+0000","last_change":"2024-09-21T07:01:02.792339+0000","last_active":"2024-09-21T07:01:04.844415+0000","last_peered":"2024-09-21T07:01:04.844415+0000","last_clean":"2024-09-21T07:01:04.844415+0000","last_became_active":"2024-09-21T07:01:02.791971+0000","last_became_peered":"2024-09-21T07:01:02.791971+0000","last_unstale":"2024-09-21T07:01:04.844415+0000","last_undegraded":"2024-09-21T07:01:04.844415+0000","last_fullsized":"2024-09-21T07:01:04.844415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:43.713520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844168+0000","last_change":"2024-09-21T07:01:03.782318+0000","last_active":"2024-09-21T07:01:04.844168+0000","last_peered":"2024-09-21T07:01:04.844168+0000","last_clean":"2024-09-21T07:01:04.844168+0000","last_became_active":"2024-09-21T07:01:03.781942+0000","last_became_peered":"2024-09-21T07:01:03.781942+0000","last_unstale":"2024-09-21T07:01:04.844168+0000","last_undegraded":"2024-09-21T07:01:04.844168+0000","last_fullsized":"2024-09-21T07:01:04.844168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:34.894160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843829+0000","last_change":"2024-09-21T07:01:02.779001+0000","last_active":"2024-09-21T07:01:04.843829+0000","last_peered":"2024-09-21T07:01:04.843829+0000","last_clean":"2024-09-21T07:01:04.843829+0000","last_became_active":"2024-09-21T07:01:02.778522+0000","last_became_peered":"2024-09-21T07:01:02.778522+0000","last_unstale":"2024-09-21T07:01:04.843829+0000","last_undegraded":"2024-09-21T07:01:04.843829+0000","last_fullsized":"2024-09-21T07:01:04.843829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:03.188520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844992+0000","last_change":"2024-09-21T07:01:03.790572+0000","last_active":"2024-09-21T07:01:04.844992+0000","last_peered":"2024-09-21T07:01:04.844992+0000","last_clean":"2024-09-21T07:01:04.844992+0000","last_became_active":"2024-09-21T07:01:03.790070+0000","last_became_peered":"2024-09-21T07:01:03.790070+0000","last_unstale":"2024-09-21T07:01:04.844992+0000","last_undegraded":"2024-09-21T07:01:04.844992+0000","last_fullsized":"2024-09-21T07:01:04.844992+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:40.124786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767672+0000","last_change":"2024-09-21T07:01:02.778072+0000","last_active":"2024-09-21T07:01:04.767672+0000","last_peered":"2024-09-21T07:01:04.767672+0000","last_clean":"2024-09-21T07:01:04.767672+0000","last_became_active":"2024-09-21T07:01:02.777714+0000","last_became_peered":"2024-09-21T07:01:02.777714+0000","last_unstale":"2024-09-21T07:01:04.767672+0000","last_undegraded":"2024-09-21T07:01:04.767672+0000","last_fullsized":"2024-09-21T07:01:04.767672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:08:05.574202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844019+0000","last_change":"2024-09-21T07:01:03.792264+0000","last_active":"2024-09-21T07:01:04.844019+0000","last_peered":"2024-09-21T07:01:04.844019+0000","last_clean":"2024-09-21T07:01:04.844019+0000","last_became_active":"2024-09-21T07:01:03.791787+0000","last_became_peered":"2024-09-21T07:01:03.791787+0000","last_unstale":"2024-09-21T07:01:04.844019+0000","last_undegraded":"2024-09-21T07:01:04.844019+0000","last_fullsized":"2024-09-21T07:01:04.844019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:12.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843915+0000","last_change":"2024-09-21T07:01:02.778713+0000","last_active":"2024-09-21T07:01:04.843915+0000","last_peered":"2024-09-21T07:01:04.843915+0000","last_clean":"2024-09-21T07:01:04.843915+0000","last_became_active":"2024-09-21T07:01:02.778375+0000","last_became_peered":"2024-09-21T07:01:02.778375+0000","last_unstale":"2024-09-21T07:01:04.843915+0000","last_undegraded":"2024-09-21T07:01:04.843915+0000","last_fullsized":"2024-09-21T07:01:04.843915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:30:41.462449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843779+0000","last_change":"2024-09-21T07:01:03.777959+0000","last_active":"2024-09-21T07:01:04.843779+0000","last_peered":"2024-09-21T07:01:04.843779+0000","last_clean":"2024-09-21T07:01:04.843779+0000","last_became_active":"2024-09-21T07:01:03.777648+0000","last_became_peered":"2024-09-21T07:01:03.777648+0000","last_unstale":"2024-09-21T07:01:04.843779+0000","last_undegraded":"2024-09-21T07:01:04.843779+0000","last_fullsized":"2024-09-21T07:01:04.843779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:32:11.993232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843470+0000","last_change":"2024-09-21T07:01:02.792375+0000","last_active":"2024-09-21T07:01:04.843470+0000","last_peered":"2024-09-21T07:01:04.843470+0000","last_clean":"2024-09-21T07:01:04.843470+0000","last_became_active":"2024-09-21T07:01:02.792035+0000","last_became_peered":"2024-09-21T07:01:02.792035+0000","last_unstale":"2024-09-21T07:01:04.843470+0000","last_undegraded":"2024-09-21T07:01:04.843470+0000","last_fullsized":"2024-09-21T07:01:04.843470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:15:38.186488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843785+0000","last_change":"2024-09-21T07:01:03.788441+0000","last_active":"2024-09-21T07:01:04.843785+0000","last_peered":"2024-09-21T07:01:04.843785+0000","last_clean":"2024-09-21T07:01:04.843785+0000","last_became_active":"2024-09-21T07:01:03.788130+0000","last_became_peered":"2024-09-21T07:01:03.788130+0000","last_unstale":"2024-09-21T07:01:04.843785+0000","last_undegraded":"2024-09-21T07:01:04.843785+0000","last_fullsized":"2024-09-21T07:01:04.843785+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:53:13.641973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768417+0000","last_change":"2024-09-21T07:01:02.776793+0000","last_active":"2024-09-21T07:01:04.768417+0000","last_peered":"2024-09-21T07:01:04.768417+0000","last_clean":"2024-09-21T07:01:04.768417+0000","last_became_active":"2024-09-21T07:01:02.775460+0000","last_became_peered":"2024-09-21T07:01:02.775460+0000","last_unstale":"2024-09-21T07:01:04.768417+0000","last_undegraded":"2024-09-21T07:01:04.768417+0000","last_fullsized":"2024-09-21T07:01:04.768417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:05:05.467271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768307+0000","last_change":"2024-09-21T07:01:03.791274+0000","last_active":"2024-09-21T07:01:04.768307+0000","last_peered":"2024-09-21T07:01:04.768307+0000","last_clean":"2024-09-21T07:01:04.768307+0000","last_became_active":"2024-09-21T07:01:03.790995+0000","last_became_peered":"2024-09-21T07:01:03.790995+0000","last_unstale":"2024-09-21T07:01:04.768307+0000","last_undegraded":"2024-09-21T07:01:04.768307+0000","last_fullsized":"2024-09-21T07:01:04.768307+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:52.515976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843395+0000","last_change":"2024-09-21T07:01:02.781006+0000","last_active":"2024-09-21T07:01:04.843395+0000","last_peered":"2024-09-21T07:01:04.843395+0000","last_clean":"2024-09-21T07:01:04.843395+0000","last_became_active":"2024-09-21T07:01:02.780061+0000","last_became_peered":"2024-09-21T07:01:02.780061+0000","last_unstale":"2024-09-21T07:01:04.843395+0000","last_undegraded":"2024-09-21T07:01:04.843395+0000","last_fullsized":"2024-09-21T07:01:04.843395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:48:26.121246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844799+0000","last_change":"2024-09-21T07:01:03.790603+0000","last_active":"2024-09-21T07:01:04.844799+0000","last_peered":"2024-09-21T07:01:04.844799+0000","last_clean":"2024-09-21T07:01:04.844799+0000","last_became_active":"2024-09-21T07:01:03.790244+0000","last_became_peered":"2024-09-21T07:01:03.790244+0000","last_unstale":"2024-09-21T07:01:04.844799+0000","last_undegraded":"2024-09-21T07:01:04.844799+0000","last_fullsized":"2024-09-21T07:01:04.844799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:07.386079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843927+0000","last_change":"2024-09-21T07:01:02.790264+0000","last_active":"2024-09-21T07:01:04.843927+0000","last_peered":"2024-09-21T07:01:04.843927+0000","last_clean":"2024-09-21T07:01:04.843927+0000","last_became_active":"2024-09-21T07:01:02.789872+0000","last_became_peered":"2024-09-21T07:01:02.789872+0000","last_unstale":"2024-09-21T07:01:04.843927+0000","last_undegraded":"2024-09-21T07:01:04.843927+0000","last_fullsized":"2024-09-21T07:01:04.843927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:26.976446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843758+0000","last_change":"2024-09-21T07:01:03.781029+0000","last_active":"2024-09-21T07:01:04.843758+0000","last_peered":"2024-09-21T07:01:04.843758+0000","last_clean":"2024-09-21T07:01:04.843758+0000","last_became_active":"2024-09-21T07:01:03.780695+0000","last_became_peered":"2024-09-21T07:01:03.780695+0000","last_unstale":"2024-09-21T07:01:04.843758+0000","last_undegraded":"2024-09-21T07:01:04.843758+0000","last_fullsized":"2024-09-21T07:01:04.843758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:21:24.208627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:05.138138+0000","last_change":"2024-09-21T07:01:02.781328+0000","last_active":"2024-09-21T07:01:05.138138+0000","last_peered":"2024-09-21T07:01:05.138138+0000","last_clean":"2024-09-21T07:01:05.138138+0000","last_became_active":"2024-09-21T07:01:02.780299+0000","last_became_peered":"2024-09-21T07:01:02.780299+0000","last_unstale":"2024-09-21T07:01:05.138138+0000","last_undegraded":"2024-09-21T07:01:05.138138+0000","last_fullsized":"2024-09-21T07:01:05.138138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:46:56.729028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844953+0000","last_change":"2024-09-21T07:01:03.795504+0000","last_active":"2024-09-21T07:01:04.844953+0000","last_peered":"2024-09-21T07:01:04.844953+0000","last_clean":"2024-09-21T07:01:04.844953+0000","last_became_active":"2024-09-21T07:01:03.795137+0000","last_became_peered":"2024-09-21T07:01:03.795137+0000","last_unstale":"2024-09-21T07:01:04.844953+0000","last_undegraded":"2024-09-21T07:01:04.844953+0000","last_fullsized":"2024-09-21T07:01:04.844953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:29:35.892752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844355+0000","last_change":"2024-09-21T07:01:02.778586+0000","last_active":"2024-09-21T07:01:04.844355+0000","last_peered":"2024-09-21T07:01:04.844355+0000","last_clean":"2024-09-21T07:01:04.844355+0000","last_became_active":"2024-09-21T07:01:02.778221+0000","last_became_peered":"2024-09-21T07:01:02.778221+0000","last_unstale":"2024-09-21T07:01:04.844355+0000","last_undegraded":"2024-09-21T07:01:04.844355+0000","last_fullsized":"2024-09-21T07:01:04.844355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:31.170615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767423+0000","last_change":"2024-09-21T07:01:03.779595+0000","last_active":"2024-09-21T07:01:04.767423+0000","last_peered":"2024-09-21T07:01:04.767423+0000","last_clean":"2024-09-21T07:01:04.767423+0000","last_became_active":"2024-09-21T07:01:03.778855+0000","last_became_peered":"2024-09-21T07:01:03.778855+0000","last_unstale":"2024-09-21T07:01:04.767423+0000","last_undegraded":"2024-09-21T07:01:04.767423+0000","last_fullsized":"2024-09-21T07:01:04.767423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:06:43.811241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844675+0000","last_change":"2024-09-21T07:01:02.790214+0000","last_active":"2024-09-21T07:01:04.844675+0000","last_peered":"2024-09-21T07:01:04.844675+0000","last_clean":"2024-09-21T07:01:04.844675+0000","last_became_active":"2024-09-21T07:01:02.789887+0000","last_became_peered":"2024-09-21T07:01:02.789887+0000","last_unstale":"2024-09-21T07:01:04.844675+0000","last_undegraded":"2024-09-21T07:01:04.844675+0000","last_fullsized":"2024-09-21T07:01:04.844675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:51.510464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.769347+0000","last_change":"2024-09-21T07:01:03.788793+0000","last_active":"2024-09-21T07:01:04.769347+0000","last_peered":"2024-09-21T07:01:04.769347+0000","last_clean":"2024-09-21T07:01:04.769347+0000","last_became_active":"2024-09-21T07:01:03.788335+0000","last_became_peered":"2024-09-21T07:01:03.788335+0000","last_unstale":"2024-09-21T07:01:04.769347+0000","last_undegraded":"2024-09-21T07:01:04.769347+0000","last_fullsized":"2024-09-21T07:01:04.769347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:45:30.201487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.844153+0000","last_change":"2024-09-21T07:01:02.777740+0000","last_active":"2024-09-21T07:01:04.844153+0000","last_peered":"2024-09-21T07:01:04.844153+0000","last_clean":"2024-09-21T07:01:04.844153+0000","last_became_active":"2024-09-21T07:01:02.777294+0000","last_became_peered":"2024-09-21T07:01:02.777294+0000","last_unstale":"2024-09-21T07:01:04.844153+0000","last_undegraded":"2024-09-21T07:01:04.844153+0000","last_fullsized":"2024-09-21T07:01:04.844153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:44.480439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768469+0000","last_change":"2024-09-21T07:01:03.799576+0000","last_active":"2024-09-21T07:01:04.768469+0000","last_peered":"2024-09-21T07:01:04.768469+0000","last_clean":"2024-09-21T07:01:04.768469+0000","last_became_active":"2024-09-21T07:01:03.799115+0000","last_became_peered":"2024-09-21T07:01:03.799115+0000","last_unstale":"2024-09-21T07:01:04.768469+0000","last_undegraded":"2024-09-21T07:01:04.768469+0000","last_fullsized":"2024-09-21T07:01:04.768469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:02:08.030021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843373+0000","last_change":"2024-09-21T07:01:02.792247+0000","last_active":"2024-09-21T07:01:04.843373+0000","last_peered":"2024-09-21T07:01:04.843373+0000","last_clean":"2024-09-21T07:01:04.843373+0000","last_became_active":"2024-09-21T07:01:02.791859+0000","last_became_peered":"2024-09-21T07:01:02.791859+0000","last_unstale":"2024-09-21T07:01:04.843373+0000","last_undegraded":"2024-09-21T07:01:04.843373+0000","last_fullsized":"2024-09-21T07:01:04.843373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:54:51.510464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843787+0000","last_change":"2024-09-21T07:01:03.782839+0000","last_active":"2024-09-21T07:01:04.843787+0000","last_peered":"2024-09-21T07:01:04.843787+0000","last_clean":"2024-09-21T07:01:04.843787+0000","last_became_active":"2024-09-21T07:01:03.782446+0000","last_became_peered":"2024-09-21T07:01:03.782446+0000","last_unstale":"2024-09-21T07:01:04.843787+0000","last_undegraded":"2024-09-21T07:01:04.843787+0000","last_fullsized":"2024-09-21T07:01:04.843787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:29.430348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.768233+0000","last_change":"2024-09-21T07:01:02.776526+0000","last_active":"2024-09-21T07:01:04.768233+0000","last_peered":"2024-09-21T07:01:04.768233+0000","last_clean":"2024-09-21T07:01:04.768233+0000","last_became_active":"2024-09-21T07:01:02.774543+0000","last_became_peered":"2024-09-21T07:01:02.774543+0000","last_unstale":"2024-09-21T07:01:04.768233+0000","last_undegraded":"2024-09-21T07:01:04.768233+0000","last_fullsized":"2024-09-21T07:01:04.768233+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:56:46.596779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767690+0000","last_change":"2024-09-21T07:01:03.788278+0000","last_active":"2024-09-21T07:01:04.767690+0000","last_peered":"2024-09-21T07:01:04.767690+0000","last_clean":"2024-09-21T07:01:04.767690+0000","last_became_active":"2024-09-21T07:01:03.787728+0000","last_became_peered":"2024-09-21T07:01:03.787728+0000","last_unstale":"2024-09-21T07:01:04.767690+0000","last_undegraded":"2024-09-21T07:01:04.767690+0000","last_fullsized":"2024-09-21T07:01:04.767690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:02.756158+0000","last_clean_scrub_stamp":"2024-09-21T07:01:02.756158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:59:04.194032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.843977+0000","last_change":"2024-09-21T07:01:02.779208+0000","last_active":"2024-09-21T07:01:04.843977+0000","last_peered":"2024-09-21T07:01:04.843977+0000","last_clean":"2024-09-21T07:01:04.843977+0000","last_became_active":"2024-09-21T07:01:02.778011+0000","last_became_peered":"2024-09-21T07:01:02.778011+0000","last_unstale":"2024-09-21T07:01:04.843977+0000","last_undegraded":"2024-09-21T07:01:04.843977+0000","last_fullsized":"2024-09-21T07:01:04.843977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:01:01.750646+0000","last_clean_scrub_stamp":"2024-09-21T07:01:01.750646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:04.375217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-21T07:01:04.767896+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:01:04.767896+0000","last_peered":"2024-09-21T07:01:04.767896+0000","last_clean":"2024-09-21T07:01:04.767896+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:01:04.767896+0000","last_undegraded":"2024-09-21T07:01:04.767896+0000","last_fullsized":"2024-09-21T07:01:04.767896+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":139786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":141376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":730714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":140540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":368640,"data_stored":139798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":962560,"data_stored":730202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":368640,"data_stored":139854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":141398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:01:12.721 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:01:12.721 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-21T07:01:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.880+0000 7fa0289a1640 1 -- 172.21.15.63:0/2282829391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0240b3750 msgr2=0x7fa02409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.880+0000 7fa0289a1640 1 --2- 172.21.15.63:0/2282829391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0240b3750 0x7fa02409aa40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa014009900 tx=0x7fa01402a610 comp rx=0 tx=0).stop 2024-09-21T07:01:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.880+0000 7fa0289a1640 1 -- 172.21.15.63:0/2282829391 shutdown_connections 2024-09-21T07:01:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.880+0000 7fa0289a1640 1 --2- 172.21.15.63:0/2282829391 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0240b3750 0x7fa02409aa40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.880+0000 7fa0289a1640 1 -- 172.21.15.63:0/2282829391 >> 172.21.15.63:0/2282829391 conn(0x7fa0240b3fb0 msgr2=0x7fa0240b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.880+0000 7fa0289a1640 1 -- 172.21.15.63:0/2282829391 shutdown_connections 2024-09-21T07:01:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.880+0000 7fa0289a1640 1 -- 172.21.15.63:0/2282829391 wait complete. 2024-09-21T07:01:12.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.882+0000 7fa0289a1640 1 Processor -- start 2024-09-21T07:01:12.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.882+0000 7fa0289a1640 1 -- start start 2024-09-21T07:01:12.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa0289a1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa02409af80 0x7fa0240cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:12.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa0289a1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0240b3750 0x7fa02414e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa0289a1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0240b3b60 0x7fa02414ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa0289a1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa0240b6c60 con 0x7fa0240b3750 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa0289a1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa0240b6ae0 con 0x7fa0240b3b60 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa0289a1640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa0240b6de0 con 0x7fa02409af80 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa021d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0240b3750 0x7fa02414e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa021d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0240b3750 0x7fa02414e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51518/0 (socket says 172.21.15.63:51518) 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa021d9b640 1 -- 172.21.15.63:0/571091208 learned_addr learned my addr 172.21.15.63:0/571091208 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa022d9d640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0240b3b60 0x7fa02414ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa02259c640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa02409af80 0x7fa0240cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa021d9b640 1 -- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa02409af80 msgr2=0x7fa0240cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa021d9b640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa02409af80 0x7fa0240cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa021d9b640 1 -- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0240b3b60 msgr2=0x7fa02414ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa021d9b640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0240b3b60 0x7fa02414ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa021d9b640 1 -- 172.21.15.63:0/571091208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa02414f5b0 con 0x7fa0240b3750 2024-09-21T07:01:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.884+0000 7fa021d9b640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0240b3750 0x7fa02414e810 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa01800c3c0 tx=0x7fa01800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.885+0000 7fa012ffd640 1 -- 172.21.15.63:0/571091208 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa018017070 con 0x7fa0240b3750 2024-09-21T07:01:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.885+0000 7fa012ffd640 1 -- 172.21.15.63:0/571091208 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0180053c0 con 0x7fa0240b3750 2024-09-21T07:01:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.885+0000 7fa0289a1640 1 -- 172.21.15.63:0/571091208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa02414c700 con 0x7fa0240b3750 2024-09-21T07:01:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.885+0000 7fa012ffd640 1 -- 172.21.15.63:0/571091208 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa018003870 con 0x7fa0240b3750 2024-09-21T07:01:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.885+0000 7fa0289a1640 1 -- 172.21.15.63:0/571091208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa02414ccc0 con 0x7fa0240b3750 2024-09-21T07:01:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.886+0000 7fa0289a1640 1 -- 172.21.15.63:0/571091208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa02409aa40 con 0x7fa0240b3750 2024-09-21T07:01:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.887+0000 7fa012ffd640 1 -- 172.21.15.63:0/571091208 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa01801a070 con 0x7fa0240b3750 2024-09-21T07:01:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.887+0000 7fa012ffd640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa004078bc0 0x7fa00407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.887+0000 7fa012ffd640 1 -- 172.21.15.63:0/571091208 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa018099ed0 con 0x7fa0240b3750 2024-09-21T07:01:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.887+0000 7fa02259c640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa004078bc0 0x7fa00407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:12.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.888+0000 7fa02259c640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa004078bc0 0x7fa00407b0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa014033000 tx=0x7fa014004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:12.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:12.892+0000 7fa012ffd640 1 -- 172.21.15.63:0/571091208 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa02409b390 con 0x7fa0240b3750 2024-09-21T07:01:13.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.151+0000 7fa0289a1640 1 -- 172.21.15.63:0/571091208 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa02406a130 con 0x7fa0240b3750 2024-09-21T07:01:13.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.155+0000 7fa012ffd640 1 -- 172.21.15.63:0/571091208 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fa018061d50 con 0x7fa0240b3750 2024-09-21T07:01:13.157 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-09-21T07:01:13.157 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDIbu5m2BwLKxAApPnoP3MWVo8VSu4x9i/uCg== 2024-09-21T07:01:13.157 INFO:teuthology.orchestra.run.smithi063.stdout: caps mds = "allow" 2024-09-21T07:01:13.157 INFO:teuthology.orchestra.run.smithi063.stdout: caps mon = "allow r" 2024-09-21T07:01:13.157 INFO:teuthology.orchestra.run.smithi063.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-21T07:01:13.157 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2024-09-21T07:01:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.157+0000 7fa0289a1640 1 -- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa004078bc0 msgr2=0x7fa00407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.157+0000 7fa0289a1640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa004078bc0 0x7fa00407b0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa014033000 tx=0x7fa014004730 comp rx=0 tx=0).stop 2024-09-21T07:01:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.157+0000 7fa0289a1640 1 -- 172.21.15.63:0/571091208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0240b3750 msgr2=0x7fa02414e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.157+0000 7fa0289a1640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0240b3750 0x7fa02414e810 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa01800c3c0 tx=0x7fa01800c880 comp rx=0 tx=0).stop 2024-09-21T07:01:13.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.157+0000 7fa0289a1640 1 -- 172.21.15.63:0/571091208 shutdown_connections 2024-09-21T07:01:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.157+0000 7fa0289a1640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa004078bc0 0x7fa00407b0d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.157+0000 7fa0289a1640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa0240b3b60 0x7fa02414ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.157+0000 7fa0289a1640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa0240b3750 0x7fa02414e810 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.157+0000 7fa0289a1640 1 --2- 172.21.15.63:0/571091208 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa02409af80 0x7fa0240cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.157+0000 7fa0289a1640 1 -- 172.21.15.63:0/571091208 >> 172.21.15.63:0/571091208 conn(0x7fa0240b3fb0 msgr2=0x7fa02409f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.157+0000 7fa0289a1640 1 -- 172.21.15.63:0/571091208 shutdown_connections 2024-09-21T07:01:13.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.157+0000 7fa0289a1640 1 -- 172.21.15.63:0/571091208 wait complete. 2024-09-21T07:01:13.170 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:01:13.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.285+0000 7f0ce5f82640 1 -- 172.21.15.63:0/1293669920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc8004800 msgr2=0x7f0cc8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:13.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.285+0000 7f0ce5f82640 1 --2- 172.21.15.63:0/1293669920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc8004800 0x7f0cc8004c10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40016c0 tx=0x7f0cc8005830 comp rx=0 tx=0).stop 2024-09-21T07:01:13.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.285+0000 7f0ce5f82640 1 -- 172.21.15.63:0/1293669920 shutdown_connections 2024-09-21T07:01:13.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.285+0000 7f0ce5f82640 1 --2- 172.21.15.63:0/1293669920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc8004800 0x7f0cc8004c10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.285+0000 7f0ce5f82640 1 -- 172.21.15.63:0/1293669920 >> 172.21.15.63:0/1293669920 conn(0x7f0ce00d45e0 msgr2=0x7f0ce00d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:13.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.285+0000 7f0ce5f82640 1 -- 172.21.15.63:0/1293669920 shutdown_connections 2024-09-21T07:01:13.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.285+0000 7f0ce5f82640 1 -- 172.21.15.63:0/1293669920 wait complete. 2024-09-21T07:01:13.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.287+0000 7f0ce5f82640 1 Processor -- start 2024-09-21T07:01:13.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.287+0000 7f0ce5f82640 1 -- start start 2024-09-21T07:01:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0ce5f82640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc8004800 0x7f0ce0161cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0ce5f82640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce01f5370 0x7f0ce01f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0ce5f82640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ce00cdcf0 0x7f0ce00b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0ce5f82640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce00d3470 con 0x7f0cc8004800 2024-09-21T07:01:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0ce5f82640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce00d32f0 con 0x7f0ce01f5370 2024-09-21T07:01:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0ce5f82640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce00d35f0 con 0x7f0ce00cdcf0 2024-09-21T07:01:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0cdf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc8004800 0x7f0ce0161cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0cdf7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc8004800 0x7f0ce0161cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51540/0 (socket says 172.21.15.63:51540) 2024-09-21T07:01:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/963805465 learned_addr learned my addr 172.21.15.63:0/963805465 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce01f5370 0x7f0ce01f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:13.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0cdffff640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ce00cdcf0 0x7f0ce00b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ce00cdcf0 msgr2=0x7f0ce00b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0cdf7fe640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ce00cdcf0 0x7f0ce00b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce01f5370 msgr2=0x7f0ce01f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0cdf7fe640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce01f5370 0x7f0ce01f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0cdf7fe640 1 -- 172.21.15.63:0/963805465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce01f5b50 con 0x7f0cc8004800 2024-09-21T07:01:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.289+0000 7f0cdf7fe640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc8004800 0x7f0ce0161cc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0006360 tx=0x7f0cd00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.290+0000 7f0cc7fff640 1 -- 172.21.15.63:0/963805465 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0015070 con 0x7f0cc8004800 2024-09-21T07:01:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.290+0000 7f0cc7fff640 1 -- 172.21.15.63:0/963805465 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cd0011920 con 0x7f0cc8004800 2024-09-21T07:01:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.290+0000 7f0ce5f82640 1 -- 172.21.15.63:0/963805465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce01f5e30 con 0x7f0cc8004800 2024-09-21T07:01:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.290+0000 7f0cc7fff640 1 -- 172.21.15.63:0/963805465 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0011d70 con 0x7f0cc8004800 2024-09-21T07:01:13.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.290+0000 7f0ce5f82640 1 -- 172.21.15.63:0/963805465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce00b5e50 con 0x7f0cc8004800 2024-09-21T07:01:13.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.291+0000 7f0ce5f82640 1 -- 172.21.15.63:0/963805465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce0050f60 con 0x7f0cc8004800 2024-09-21T07:01:13.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.291+0000 7f0cc7fff640 1 -- 172.21.15.63:0/963805465 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0cd0018070 con 0x7f0cc8004800 2024-09-21T07:01:13.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.292+0000 7f0cc7fff640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0ccc078b90 0x7f0ccc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:13.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.292+0000 7f0cc7fff640 1 -- 172.21.15.63:0/963805465 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f0cd009b9f0 con 0x7f0cc8004800 2024-09-21T07:01:13.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.292+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0ccc078b90 0x7f0ccc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:13.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.293+0000 7f0cdeffd640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0ccc078b90 0x7f0ccc07b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4032000 tx=0x7f0cd402c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:13.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.296+0000 7f0cc7fff640 1 -- 172.21.15.63:0/963805465 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0ce0050f60 con 0x7f0cc8004800 2024-09-21T07:01:13.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.520+0000 7f0ce5f82640 1 -- 172.21.15.63:0/963805465 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ce00d0ee0 con 0x7f0cc8004800 2024-09-21T07:01:13.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.521+0000 7f0cc7fff640 1 -- 172.21.15.63:0/963805465 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5220 (secure 0 0 0) 0x7f0cd0063880 con 0x7f0cc8004800 2024-09-21T07:01:13.523 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:13.523 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":17,"btime":"2024-09-21T07:01:06:786372+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/585708774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":585708774},{"type":"v1","addr":"172.21.15.71:6836","nonce":585708774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4837,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2545148827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":2545148827},{"type":"v1","addr":"172.21.15.71:6837","nonce":2545148827}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/2618757202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2618757202},{"type":"v1","addr":"172.21.15.63:6834","nonce":2618757202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:01:03.150809+0000","modified":"2024-09-21T07:01:06.170075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.63:6835/3748950985","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":3748950985},{"type":"v1","addr":"172.21.15.63:6835","nonce":3748950985}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4905,"qdb_cluster":[4905]},"id":2}]} 2024-09-21T07:01:13.523 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 17 2024-09-21T07:01:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.523+0000 7f0ce5f82640 1 -- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0ccc078b90 msgr2=0x7f0ccc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.523+0000 7f0ce5f82640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0ccc078b90 0x7f0ccc07b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4032000 tx=0x7f0cd402c040 comp rx=0 tx=0).stop 2024-09-21T07:01:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.523+0000 7f0ce5f82640 1 -- 172.21.15.63:0/963805465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc8004800 msgr2=0x7f0ce0161cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.523+0000 7f0ce5f82640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc8004800 0x7f0ce0161cc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0006360 tx=0x7f0cd00039c0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.523+0000 7f0ce5f82640 1 -- 172.21.15.63:0/963805465 shutdown_connections 2024-09-21T07:01:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.523+0000 7f0ce5f82640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0ccc078b90 0x7f0ccc07b0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.523+0000 7f0ce5f82640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0ce00cdcf0 0x7f0ce00b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.523+0000 7f0ce5f82640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0ce01f5370 0x7f0ce01f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.523+0000 7f0ce5f82640 1 --2- 172.21.15.63:0/963805465 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0cc8004800 0x7f0ce0161cc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:13.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.523+0000 7f0ce5f82640 1 -- 172.21.15.63:0/963805465 >> 172.21.15.63:0/963805465 conn(0x7f0ce00d45e0 msgr2=0x7f0ce00b80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:13.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.523+0000 7f0ce5f82640 1 -- 172.21.15.63:0/963805465 shutdown_connections 2024-09-21T07:01:13.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:13.523+0000 7f0ce5f82640 1 -- 172.21.15.63:0/963805465 wait complete. 2024-09-21T07:01:13.939 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:01:03.150809+0000', 'modified': '2024-09-21T07:01:06.170075+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4905}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4905': {'gid': 4905, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.63:6835/3748950985', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6833', 'nonce': 3748950985}, {'type': 'v1', 'addr': '172.21.15.63:6835', 'nonce': 3748950985}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4905, 'qdb_cluster': [4905]} 2024-09-21T07:01:13.940 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:01:13.940 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T07:01:14.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.060+0000 7febd7dc6640 1 -- 172.21.15.63:0/3676002945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd00b7530 msgr2=0x7febd00d2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.060+0000 7febd7dc6640 1 --2- 172.21.15.63:0/3676002945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd00b7530 0x7febd00d2530 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7febc0009bb0 tx=0x7febc002a8b0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.060+0000 7febd7dc6640 1 -- 172.21.15.63:0/3676002945 shutdown_connections 2024-09-21T07:01:14.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.060+0000 7febd7dc6640 1 --2- 172.21.15.63:0/3676002945 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7febd015ef00 0x7febd00d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.060+0000 7febd7dc6640 1 --2- 172.21.15.63:0/3676002945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd00b7530 0x7febd00d2530 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.060+0000 7febd7dc6640 1 -- 172.21.15.63:0/3676002945 >> 172.21.15.63:0/3676002945 conn(0x7febd008bfd0 msgr2=0x7febd00d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:14.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.060+0000 7febd7dc6640 1 -- 172.21.15.63:0/3676002945 shutdown_connections 2024-09-21T07:01:14.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.060+0000 7febd7dc6640 1 -- 172.21.15.63:0/3676002945 wait complete. 2024-09-21T07:01:14.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.062+0000 7febd7dc6640 1 Processor -- start 2024-09-21T07:01:14.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.062+0000 7febd7dc6640 1 -- start start 2024-09-21T07:01:14.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd7dc6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd00b2650 0x7febd01f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd7dc6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd00b7530 0x7febd00cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd7dc6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7febd015ef00 0x7febd00cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd7dc6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7febd00b3500 con 0x7febd00b7530 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd7dc6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7febd00b3380 con 0x7febd00b2650 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd7dc6640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7febd00d0320 con 0x7febd015ef00 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd5361640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd00b7530 0x7febd00cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd5361640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd00b7530 0x7febd00cad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51550/0 (socket says 172.21.15.63:51550) 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd5361640 1 -- 172.21.15.63:0/2866799325 learned_addr learned my addr 172.21.15.63:0/2866799325 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd5b62640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd00b2650 0x7febd01f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd6363640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7febd015ef00 0x7febd00cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd5361640 1 -- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7febd015ef00 msgr2=0x7febd00cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd5361640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7febd015ef00 0x7febd00cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd5361640 1 -- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd00b2650 msgr2=0x7febd01f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd5361640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd00b2650 0x7febd01f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd5361640 1 -- 172.21.15.63:0/2866799325 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd00c9f60 con 0x7febd00b7530 2024-09-21T07:01:14.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd5b62640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd00b2650 0x7febd01f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:14.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.064+0000 7febd5361640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd00b7530 0x7febd00cad20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7febc400e790 tx=0x7febc400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:14.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.065+0000 7febce7fc640 1 -- 172.21.15.63:0/2866799325 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc400eea0 con 0x7febd00b7530 2024-09-21T07:01:14.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.065+0000 7febce7fc640 1 -- 172.21.15.63:0/2866799325 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febc400ccc0 con 0x7febd00b7530 2024-09-21T07:01:14.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.065+0000 7febce7fc640 1 -- 172.21.15.63:0/2866799325 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4005280 con 0x7febd00b7530 2024-09-21T07:01:14.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.065+0000 7febd7dc6640 1 -- 172.21.15.63:0/2866799325 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd00ca240 con 0x7febd00b7530 2024-09-21T07:01:14.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.065+0000 7febd7dc6640 1 -- 172.21.15.63:0/2866799325 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd00ca800 con 0x7febd00b7530 2024-09-21T07:01:14.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.066+0000 7febce7fc640 1 -- 172.21.15.63:0/2866799325 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7febc4005420 con 0x7febd00b7530 2024-09-21T07:01:14.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.067+0000 7febce7fc640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7febbc078bc0 0x7febbc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.067+0000 7febce7fc640 1 -- 172.21.15.63:0/2866799325 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7febc409b5b0 con 0x7febd00b7530 2024-09-21T07:01:14.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.067+0000 7febd5b62640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7febbc078bc0 0x7febbc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.068+0000 7febd5b62640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7febbc078bc0 0x7febbc07b0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7febd00d4e80 tx=0x7febc0004ab0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:14.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.068+0000 7febdee18740 1 Processor -- start 2024-09-21T07:01:14.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.068+0000 7febdee18740 1 -- start start 2024-09-21T07:01:14.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.069+0000 7febdee18740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dc0e270 0x55618dfdffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.069+0000 7febdee18740 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbe53b0 0x55618dfe0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.069+0000 7febdee18740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dbed590 0x55618dffd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.069+0000 7febdee18740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55618df28820 con 0x55618dbed590 2024-09-21T07:01:14.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.069+0000 7febdee18740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55618df17c50 con 0x55618dc0e270 2024-09-21T07:01:14.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.069+0000 7febdee18740 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x55618df1ba60 con 0x55618dbe53b0 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febd6363640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dbed590 0x55618dffd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febd5b62640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dc0e270 0x55618dfdffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febd6363640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dbed590 0x55618dffd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51552/0 (socket says 172.21.15.63:51552) 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febd6363640 1 -- 172.21.15.63:0/2400658592 learned_addr learned my addr 172.21.15.63:0/2400658592 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febd5361640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbe53b0 0x55618dfe0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febd6363640 1 -- 172.21.15.63:0/2400658592 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbe53b0 msgr2=0x55618dfe0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febd6363640 1 --2- 172.21.15.63:0/2400658592 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbe53b0 0x55618dfe0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febd6363640 1 -- 172.21.15.63:0/2400658592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dc0e270 msgr2=0x55618dfdffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febd6363640 1 --2- 172.21.15.63:0/2400658592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dc0e270 0x55618dfdffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febd6363640 1 -- 172.21.15.63:0/2400658592 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55618dc79850 con 0x55618dbed590 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febd5b62640 1 --2- 172.21.15.63:0/2400658592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dc0e270 0x55618dfdffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febd6363640 1 --2- 172.21.15.63:0/2400658592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dbed590 0x55618dffd400 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7febc80014a0 tx=0x7febc8001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d84b1f5cf6da939 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febb77fe640 1 -- 172.21.15.63:0/2400658592 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc800e670 con 0x55618dbed590 2024-09-21T07:01:14.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febb77fe640 1 -- 172.21.15.63:0/2400658592 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febc8019070 con 0x55618dbed590 2024-09-21T07:01:14.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.070+0000 7febb77fe640 1 -- 172.21.15.63:0/2400658592 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc800eb60 con 0x55618dbed590 2024-09-21T07:01:14.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.071+0000 7febdee18740 1 -- 172.21.15.63:0/2400658592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dbed590 msgr2=0x55618dffd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.071+0000 7febdee18740 1 --2- 172.21.15.63:0/2400658592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dbed590 0x55618dffd400 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7febc80014a0 tx=0x7febc8001960 comp rx=0 tx=0).stop 2024-09-21T07:01:14.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.071+0000 7febdee18740 1 -- 172.21.15.63:0/2400658592 shutdown_connections 2024-09-21T07:01:14.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.071+0000 7febdee18740 1 --2- 172.21.15.63:0/2400658592 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dbed590 0x55618dffd400 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.071+0000 7febdee18740 1 --2- 172.21.15.63:0/2400658592 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbe53b0 0x55618dfe0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.071+0000 7febdee18740 1 --2- 172.21.15.63:0/2400658592 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dc0e270 0x55618dfdffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.071+0000 7febdee18740 1 -- 172.21.15.63:0/2400658592 >> 172.21.15.63:0/2400658592 conn(0x55618dc023c0 msgr2=0x55618dfb6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:14.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.071+0000 7febdee18740 1 -- 172.21.15.63:0/2400658592 shutdown_connections 2024-09-21T07:01:14.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.071+0000 7febdee18740 1 -- 172.21.15.63:0/2400658592 wait complete. 2024-09-21T07:01:14.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.072+0000 7febdee18740 1 -- start start 2024-09-21T07:01:14.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.072+0000 7febdee18740 1 Processor -- start 2024-09-21T07:01:14.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febdee18740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbe53b0 0x55618dfce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febdee18740 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbed590 0x55618dfb51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febdee18740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfb56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febdee18740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55618dc88620 con 0x55618dc0e270 2024-09-21T07:01:14.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febdee18740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55618debd5f0 con 0x55618dbe53b0 2024-09-21T07:01:14.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febdee18740 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x55618dfe0a40 con 0x55618dbed590 2024-09-21T07:01:14.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febdee18740 10 client.0 _ll_register_callbacks cb 0x55618dec10a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:01:14.079 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febd6363640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfb56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febd6363640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfb56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51560/0 (socket says 172.21.15.63:51560) 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febd6363640 1 -- 172.21.15.63:0/2957566395 learned_addr learned my addr 172.21.15.63:0/2957566395 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febd5b62640 1 --2- 172.21.15.63:0/2957566395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbe53b0 0x55618dfce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febd5361640 1 --2- 172.21.15.63:0/2957566395 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbed590 0x55618dfb51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febd6363640 1 -- 172.21.15.63:0/2957566395 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbed590 msgr2=0x55618dfb51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febd6363640 1 --2- 172.21.15.63:0/2957566395 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbed590 0x55618dfb51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febd6363640 1 -- 172.21.15.63:0/2957566395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbe53b0 msgr2=0x55618dfce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febd6363640 1 --2- 172.21.15.63:0/2957566395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbe53b0 0x55618dfce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febd6363640 1 -- 172.21.15.63:0/2957566395 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55618dcf06b0 con 0x55618dc0e270 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febd6363640 1 --2- 172.21.15.63:0/2957566395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfb56e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7febc8016040 tx=0x7febc800eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c01676270510101 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.074+0000 7febb4ff9640 1 -- 172.21.15.63:0/2957566395 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8005230 con 0x55618dc0e270 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febb4ff9640 1 -- 172.21.15.63:0/2957566395 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7febc80053d0 con 0x55618dc0e270 2024-09-21T07:01:14.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febdee18740 1 -- 172.21.15.63:0/2957566395 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febc8019070 con 0x55618dc0e270 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febb4ff9640 1 -- 172.21.15.63:0/2957566395 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7febc802e050 con 0x55618dc0e270 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febdee18740 10 client.5076 fetch_fsmap learned FSMap version 17 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febdee18740 1 -- 172.21.15.63:0/2957566395 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55618dfce820 con 0x55618dc0e270 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febb4ff9640 1 -- 172.21.15.63:0/2957566395 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febc8019070 con 0x55618dc0e270 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febb4ff9640 1 -- 172.21.15.63:0/2957566395 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7febc8031020 con 0x55618dc0e270 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febdee18740 10 client.5076 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febdee18740 10 client.5076 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febdee18740 20 client.5076 populate_metadata read hostname 'smithi063' 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febdee18740 1 --2- 172.21.15.63:0/2957566395 >> [v2:172.21.15.63:6833/3748950985,v1:172.21.15.63:6835/3748950985] conn(0x55618dbcce40 0x55618e00d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febdee18740 4 client.5076 mds_command: new command op to 4905 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febdee18740 1 -- 172.21.15.63:0/2957566395 --> [v2:172.21.15.63:6833/3748950985,v1:172.21.15.63:6835/3748950985] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55618df2a770 con 0x55618dbcce40 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.075+0000 7febd5b62640 1 --2- 172.21.15.63:0/2957566395 >> [v2:172.21.15.63:6833/3748950985,v1:172.21.15.63:6835/3748950985] conn(0x55618dbcce40 0x55618e00d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.076+0000 7febb4ff9640 10 client.5076 ms_handle_connect on v2:172.21.15.63:6833/3748950985 2024-09-21T07:01:14.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.076+0000 7febd5b62640 1 --2- 172.21.15.63:0/2957566395 >> [v2:172.21.15.63:6833/3748950985,v1:172.21.15.63:6835/3748950985] conn(0x55618dbcce40 0x55618e00d530 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=362170c8c2622fed server_cookie=8ccc620e4943de03 in_seq=0 out_seq=0 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.076+0000 7febb4ff9640 1 -- 172.21.15.63:0/2957566395 <== mds.0 v2:172.21.15.63:6833/3748950985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55618df2a770 con 0x55618dbcce40 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.076+0000 7febb4ff9640 10 client.5076 handle_command_reply: tid=0 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.076+0000 7febdee18740 1 client.5076 shutdown 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.076+0000 7febdee18740 1 -- 172.21.15.63:0/2957566395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 msgr2=0x55618dfb56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.076+0000 7febdee18740 1 --2- 172.21.15.63:0/2957566395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfb56e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7febc8016040 tx=0x7febc800eb30 comp rx=0 tx=0).stop 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.077+0000 7febdee18740 1 -- 172.21.15.63:0/2957566395 shutdown_connections 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.077+0000 7febdee18740 1 --2- 172.21.15.63:0/2957566395 >> [v2:172.21.15.63:6833/3748950985,v1:172.21.15.63:6835/3748950985] conn(0x55618dbcce40 0x55618e00d530 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.077+0000 7febdee18740 1 --2- 172.21.15.63:0/2957566395 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfb56e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.077+0000 7febb4ff9640 0 client.5076 ms_handle_reset on v2:172.21.15.63:6833/3748950985 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.077+0000 7febdee18740 1 --2- 172.21.15.63:0/2957566395 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbed590 0x55618dfb51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.077+0000 7febdee18740 1 --2- 172.21.15.63:0/2957566395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbe53b0 0x55618dfce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.077+0000 7febdee18740 1 -- 172.21.15.63:0/2957566395 >> 172.21.15.63:0/2957566395 conn(0x55618dc023c0 msgr2=0x55618dfb6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.077+0000 7febdee18740 1 -- 172.21.15.63:0/2957566395 shutdown_connections 2024-09-21T07:01:14.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.077+0000 7febdee18740 1 -- 172.21.15.63:0/2957566395 wait complete. 2024-09-21T07:01:14.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.077+0000 7febdee18740 20 client.5076 trim_cache size 0 max 16384 2024-09-21T07:01:14.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.095+0000 7febdee18740 1 Processor -- start 2024-09-21T07:01:14.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.095+0000 7febdee18740 1 -- start start 2024-09-21T07:01:14.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.096+0000 7febdee18740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbe53b0 0x55618e01e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.096+0000 7febdee18740 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbed590 0x55618dfceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.096+0000 7febdee18740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.096+0000 7febdee18740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7febd00cde00 con 0x55618dc0e270 2024-09-21T07:01:14.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.096+0000 7febdee18740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7febd01f5d30 con 0x55618dbe53b0 2024-09-21T07:01:14.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.096+0000 7febdee18740 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7febd00cd7b0 con 0x55618dbed590 2024-09-21T07:01:14.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febd6363640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febd6363640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51576/0 (socket says 172.21.15.63:51576) 2024-09-21T07:01:14.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febd6363640 1 -- 172.21.15.63:0/1112269097 learned_addr learned my addr 172.21.15.63:0/1112269097 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:14.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febd5b62640 1 --2- 172.21.15.63:0/1112269097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbe53b0 0x55618e01e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febd5361640 1 --2- 172.21.15.63:0/1112269097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbed590 0x55618dfceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febd6363640 1 -- 172.21.15.63:0/1112269097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbed590 msgr2=0x55618dfceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:14.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febd6363640 1 --2- 172.21.15.63:0/1112269097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbed590 0x55618dfceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febd6363640 1 -- 172.21.15.63:0/1112269097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbe53b0 msgr2=0x55618e01e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:14.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febd6363640 1 --2- 172.21.15.63:0/1112269097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbe53b0 0x55618e01e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febd6363640 1 -- 172.21.15.63:0/1112269097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55618dffc280 con 0x55618dc0e270 2024-09-21T07:01:14.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febd5361640 1 --2- 172.21.15.63:0/1112269097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbed590 0x55618dfceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:14.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febd6363640 1 --2- 172.21.15.63:0/1112269097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfceff0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7febc8015650 tx=0x7febc8001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e328e02b148a8893 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:14.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febb6ffd640 1 -- 172.21.15.63:0/1112269097 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8006a90 con 0x55618dc0e270 2024-09-21T07:01:14.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febb6ffd640 1 -- 172.21.15.63:0/1112269097 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febc8019040 con 0x55618dc0e270 2024-09-21T07:01:14.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.097+0000 7febb6ffd640 1 -- 172.21.15.63:0/1112269097 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8015730 con 0x55618dc0e270 2024-09-21T07:01:14.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.098+0000 7febdee18740 1 -- 172.21.15.63:0/1112269097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 msgr2=0x55618dfceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.098+0000 7febdee18740 1 --2- 172.21.15.63:0/1112269097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfceff0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7febc8015650 tx=0x7febc8001960 comp rx=0 tx=0).stop 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.098+0000 7febdee18740 1 -- 172.21.15.63:0/1112269097 shutdown_connections 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.098+0000 7febdee18740 1 --2- 172.21.15.63:0/1112269097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfceff0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.098+0000 7febdee18740 1 --2- 172.21.15.63:0/1112269097 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbed590 0x55618dfceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.098+0000 7febdee18740 1 --2- 172.21.15.63:0/1112269097 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbe53b0 0x55618e01e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.098+0000 7febdee18740 1 -- 172.21.15.63:0/1112269097 >> 172.21.15.63:0/1112269097 conn(0x55618dc023c0 msgr2=0x55618dfb6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.098+0000 7febdee18740 1 -- 172.21.15.63:0/1112269097 shutdown_connections 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.098+0000 7febdee18740 1 -- 172.21.15.63:0/1112269097 wait complete. 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.099+0000 7febdee18740 1 -- start start 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.099+0000 7febdee18740 1 Processor -- start 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febdee18740 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbe53b0 0x55618e05f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febdee18740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbed590 0x55618dfcea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febdee18740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfcef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febdee18740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55618dfcc1c0 con 0x55618dc0e270 2024-09-21T07:01:14.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febdee18740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55618dfcc6f0 con 0x55618dbed590 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febdee18740 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x55618dff27f0 con 0x55618dbe53b0 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febdee18740 10 client.0 _ll_register_callbacks cb 0x7febc4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febd6363640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfcef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febd6363640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfcef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51592/0 (socket says 172.21.15.63:51592) 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febd6363640 1 -- 172.21.15.63:0/1777663679 learned_addr learned my addr 172.21.15.63:0/1777663679 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febd5361640 1 --2- 172.21.15.63:0/1777663679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbed590 0x55618dfcea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febd5b62640 1 --2- 172.21.15.63:0/1777663679 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbe53b0 0x55618e05f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febd6363640 1 -- 172.21.15.63:0/1777663679 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbe53b0 msgr2=0x55618e05f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febd6363640 1 --2- 172.21.15.63:0/1777663679 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbe53b0 0x55618e05f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febd6363640 1 -- 172.21.15.63:0/1777663679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbed590 msgr2=0x55618dfcea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febd6363640 1 --2- 172.21.15.63:0/1777663679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbed590 0x55618dfcea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febd6363640 1 -- 172.21.15.63:0/1777663679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55618e05f910 con 0x55618dc0e270 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febd6363640 1 --2- 172.21.15.63:0/1777663679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfcef90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7febc8010010 tx=0x7febc800e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b88e1bac12769d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:14.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febb4ff9640 1 -- 172.21.15.63:0/1777663679 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8006ca0 con 0x55618dc0e270 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febdee18740 1 -- 172.21.15.63:0/1777663679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febc8019040 con 0x55618dc0e270 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.101+0000 7febb4ff9640 1 -- 172.21.15.63:0/1777663679 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7febc803bae0 con 0x55618dc0e270 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.102+0000 7febb4ff9640 1 -- 172.21.15.63:0/1777663679 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7febc8006e40 con 0x55618dc0e270 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.102+0000 7febdee18740 10 client.5082 fetch_fsmap learned FSMap version 17 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.102+0000 7febdee18740 1 -- 172.21.15.63:0/1777663679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55618e062710 con 0x55618dc0e270 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.102+0000 7febb4ff9640 1 -- 172.21.15.63:0/1777663679 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febc8019040 con 0x55618dc0e270 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.102+0000 7febb4ff9640 1 -- 172.21.15.63:0/1777663679 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7febc8031070 con 0x55618dc0e270 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.102+0000 7febdee18740 10 client.5082 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.102+0000 7febdee18740 10 client.5082 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.102+0000 7febdee18740 20 client.5082 populate_metadata read hostname 'smithi063' 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.102+0000 7febdee18740 1 --2- 172.21.15.63:0/1777663679 >> [v2:172.21.15.63:6833/3748950985,v1:172.21.15.63:6835/3748950985] conn(0x55618e07d3e0 0x55618dfdfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.102+0000 7febdee18740 4 client.5082 mds_command: new command op to 4905 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:01:14.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.102+0000 7febdee18740 1 -- 172.21.15.63:0/1777663679 --> [v2:172.21.15.63:6833/3748950985,v1:172.21.15.63:6835/3748950985] -- command(tid 0: {"prefix": "status"}) -- 0x55618dff5a40 con 0x55618e07d3e0 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.102+0000 7febd5b62640 1 --2- 172.21.15.63:0/1777663679 >> [v2:172.21.15.63:6833/3748950985,v1:172.21.15.63:6835/3748950985] conn(0x55618e07d3e0 0x55618dfdfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febd5b62640 1 --2- 172.21.15.63:0/1777663679 >> [v2:172.21.15.63:6833/3748950985,v1:172.21.15.63:6835/3748950985] conn(0x55618e07d3e0 0x55618dfdfc80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eef1435d873a18c2 server_cookie=84cfa574a5b2c4f3 in_seq=0 out_seq=0 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febb4ff9640 10 client.5082 ms_handle_connect on v2:172.21.15.63:6833/3748950985 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febb4ff9640 1 -- 172.21.15.63:0/1777663679 <== mds.0 v2:172.21.15.63:6833/3748950985 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55618dff5a40 con 0x55618e07d3e0 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febb4ff9640 10 client.5082 handle_command_reply: tid=0 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febdee18740 1 client.5082 shutdown 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febdee18740 1 -- 172.21.15.63:0/1777663679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 msgr2=0x55618dfcef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febdee18740 1 --2- 172.21.15.63:0/1777663679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfcef90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7febc8010010 tx=0x7febc800e730 comp rx=0 tx=0).stop 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febdee18740 1 -- 172.21.15.63:0/1777663679 shutdown_connections 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febdee18740 1 --2- 172.21.15.63:0/1777663679 >> [v2:172.21.15.63:6833/3748950985,v1:172.21.15.63:6835/3748950985] conn(0x55618e07d3e0 0x55618dfdfc80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febdee18740 1 --2- 172.21.15.63:0/1777663679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55618dc0e270 0x55618dfcef90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febdee18740 1 --2- 172.21.15.63:0/1777663679 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55618dbed590 0x55618dfcea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febdee18740 1 --2- 172.21.15.63:0/1777663679 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55618dbe53b0 0x55618e05f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febb4ff9640 0 client.5082 ms_handle_reset on v2:172.21.15.63:6833/3748950985 2024-09-21T07:01:14.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febdee18740 1 -- 172.21.15.63:0/1777663679 >> 172.21.15.63:0/1777663679 conn(0x55618dc023c0 msgr2=0x55618dfb6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:14.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febdee18740 1 -- 172.21.15.63:0/1777663679 shutdown_connections 2024-09-21T07:01:14.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febdee18740 1 -- 172.21.15.63:0/1777663679 wait complete. 2024-09-21T07:01:14.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.103+0000 7febdee18740 20 client.5082 trim_cache size 0 max 16384 2024-09-21T07:01:14.111 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T07:01:14.111 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "2c317557-147d-48e9-8f3c-bb88131d3e37", 2024-09-21T07:01:14.111 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-09-21T07:01:14.111 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4905, 2024-09-21T07:01:14.111 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-21T07:01:14.111 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-21T07:01:14.112 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-21T07:01:14.112 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 10.339988367, 2024-09-21T07:01:14.112 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 17, 2024-09-21T07:01:14.112 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 33, 2024-09-21T07:01:14.112 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 33, 2024-09-21T07:01:14.112 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 17.200825771000002 2024-09-21T07:01:14.112 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T07:01:14.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.104+0000 7febd7dc6640 1 -- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7febbc078bc0 msgr2=0x7febbc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.104+0000 7febd7dc6640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7febbc078bc0 0x7febbc07b0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7febd00d4e80 tx=0x7febc0004ab0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.104+0000 7febd7dc6640 1 -- 172.21.15.63:0/2866799325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd00b7530 msgr2=0x7febd00cad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.104+0000 7febd7dc6640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd00b7530 0x7febd00cad20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7febc400e790 tx=0x7febc400ec50 comp rx=0 tx=0).stop 2024-09-21T07:01:14.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.104+0000 7febd7dc6640 1 -- 172.21.15.63:0/2866799325 shutdown_connections 2024-09-21T07:01:14.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.104+0000 7febd7dc6640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7febbc078bc0 0x7febbc07b0d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.104+0000 7febd7dc6640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7febd015ef00 0x7febd00cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.104+0000 7febd7dc6640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7febd00b7530 0x7febd00cad20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.104+0000 7febd7dc6640 1 --2- 172.21.15.63:0/2866799325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7febd00b2650 0x7febd01f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.104+0000 7febd7dc6640 1 -- 172.21.15.63:0/2866799325 >> 172.21.15.63:0/2866799325 conn(0x7febd008bfd0 msgr2=0x7febd00b99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:14.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.104+0000 7febd7dc6640 1 -- 172.21.15.63:0/2866799325 shutdown_connections 2024-09-21T07:01:14.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.104+0000 7febd7dc6640 1 -- 172.21.15.63:0/2866799325 wait complete. 2024-09-21T07:01:14.117 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-21T07:01:14.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.232+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1966060194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f140040e0 msgr2=0x7f2f14004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.232+0000 7f2f2f3c6640 1 --2- 172.21.15.63:0/1966060194 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f140040e0 0x7f2f14004800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800c4a0 tx=0x7f2f14005830 comp rx=0 tx=0).stop 2024-09-21T07:01:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.232+0000 7f2f2d963640 1 -- 172.21.15.63:0/1966060194 reap_dead start 2024-09-21T07:01:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.232+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1966060194 shutdown_connections 2024-09-21T07:01:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.232+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1966060194 >> 172.21.15.63:0/1966060194 conn(0x7f2f280b3fb0 msgr2=0x7f2f280b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.233+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1966060194 shutdown_connections 2024-09-21T07:01:14.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.233+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1966060194 wait complete. 2024-09-21T07:01:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.234+0000 7f2f2f3c6640 1 Processor -- start 2024-09-21T07:01:14.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.234+0000 7f2f2f3c6640 1 -- start start 2024-09-21T07:01:14.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2f3c6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f140040e0 0x7f2f281f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2f3c6640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f281508b0 0x7f2f2809d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2f3c6640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f28150cc0 0x7f2f2809df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2f3c6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2f280b6730 con 0x7f2f140040e0 2024-09-21T07:01:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2f3c6640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2f280ce810 con 0x7f2f28150cc0 2024-09-21T07:01:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2f3c6640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f2f280b68b0 con 0x7f2f281508b0 2024-09-21T07:01:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2d162640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f140040e0 0x7f2f281f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2d162640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f140040e0 0x7f2f281f5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51610/0 (socket says 172.21.15.63:51610) 2024-09-21T07:01:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2d162640 1 -- 172.21.15.63:0/1337202668 learned_addr learned my addr 172.21.15.63:0/1337202668 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2d963640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f28150cc0 0x7f2f2809df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2c961640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f281508b0 0x7f2f2809d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2d162640 1 -- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f281508b0 msgr2=0x7f2f2809d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2d162640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f281508b0 0x7f2f2809d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2d162640 1 -- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f28150cc0 msgr2=0x7f2f2809df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2d162640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f28150cc0 0x7f2f2809df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2d162640 1 -- 172.21.15.63:0/1337202668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f28159280 con 0x7f2f140040e0 2024-09-21T07:01:14.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f2d162640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f140040e0 0x7f2f281f5a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2f24011ae0 tx=0x7f2f24009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:14.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.236+0000 7f2f1dffb640 1 -- 172.21.15.63:0/1337202668 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2401e070 con 0x7f2f140040e0 2024-09-21T07:01:14.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.237+0000 7f2f1dffb640 1 -- 172.21.15.63:0/1337202668 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f2400fe70 con 0x7f2f140040e0 2024-09-21T07:01:14.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.237+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1337202668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f28159560 con 0x7f2f140040e0 2024-09-21T07:01:14.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.237+0000 7f2f1dffb640 1 -- 172.21.15.63:0/1337202668 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f24004290 con 0x7f2f140040e0 2024-09-21T07:01:14.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.237+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1337202668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f28159b20 con 0x7f2f140040e0 2024-09-21T07:01:14.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.238+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1337202668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f280b6e40 con 0x7f2f140040e0 2024-09-21T07:01:14.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.239+0000 7f2f1dffb640 1 -- 172.21.15.63:0/1337202668 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f24021070 con 0x7f2f140040e0 2024-09-21T07:01:14.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.239+0000 7f2f1dffb640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2f0c078b90 0x7f2f0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:14.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.239+0000 7f2f1dffb640 1 -- 172.21.15.63:0/1337202668 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f2f2409b820 con 0x7f2f140040e0 2024-09-21T07:01:14.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.239+0000 7f2f2c961640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2f0c078b90 0x7f2f0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:14.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.240+0000 7f2f2c961640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2f0c078b90 0x7f2f0c07b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2f18033000 tx=0x7f2f2809bdc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:14.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.244+0000 7f2f1dffb640 1 -- 172.21.15.63:0/1337202668 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f2f240636d0 con 0x7f2f140040e0 2024-09-21T07:01:14.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.472+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1337202668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2f2806a130 con 0x7f2f140040e0 2024-09-21T07:01:14.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.472+0000 7f2f1dffb640 1 -- 172.21.15.63:0/1337202668 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f2f24068100 con 0x7f2f140040e0 2024-09-21T07:01:14.474 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T07:01:14.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.475+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2f0c078b90 msgr2=0x7f2f0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.475+0000 7f2f2f3c6640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2f0c078b90 0x7f2f0c07b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2f18033000 tx=0x7f2f2809bdc0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.475+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1337202668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f140040e0 msgr2=0x7f2f281f5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:14.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.475+0000 7f2f2f3c6640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f140040e0 0x7f2f281f5a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2f24011ae0 tx=0x7f2f24009e90 comp rx=0 tx=0).stop 2024-09-21T07:01:14.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.475+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1337202668 shutdown_connections 2024-09-21T07:01:14.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.475+0000 7f2f2f3c6640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2f0c078b90 0x7f2f0c07b0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.475+0000 7f2f2f3c6640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2f28150cc0 0x7f2f2809df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.475+0000 7f2f2f3c6640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f2f281508b0 0x7f2f2809d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.475+0000 7f2f2f3c6640 1 --2- 172.21.15.63:0/1337202668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f140040e0 0x7f2f281f5a80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:14.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.475+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1337202668 >> 172.21.15.63:0/1337202668 conn(0x7f2f280b3fb0 msgr2=0x7f2f2815e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:14.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.475+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1337202668 shutdown_connections 2024-09-21T07:01:14.478 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14.475+0000 7f2f2f3c6640 1 -- 172.21.15.63:0/1337202668 wait complete. 2024-09-21T07:01:14.488 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T07:01:14.488 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T07:01:14.488 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-09-21T07:01:14.488 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T07:01:14.488 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T07:01:14.488 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T07:01:14.488 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-21T07:01:14.488 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T07:01:14.488 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:01:14.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:14.489 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-09-21T07:01:14.505 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T07:01:14.505 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T07:01:14.505 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T07:01:14.505 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:01:14.505 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-09-21T07:01:14.505 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:01:14.505 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:01:14.505 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:01:14.505 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42751sec preferred_lft 42751sec 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link noprefixroute 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 2e:ea:81:6e:70:d5 brd ff:ff:ff:ff:ff:ff 2024-09-21T07:01:14.506 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-21T07:01:14.507 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:01:14.507 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::f829:63ff:feb6:60/64 scope link 2024-09-21T07:01:14.507 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:01:14.507 INFO:teuthology.orchestra.run.smithi063.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:01:14.507 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 2e:ea:81:6e:70:d5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:01:14.507 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::2cea:81ff:fe6e:70d5/64 scope link 2024-09-21T07:01:14.507 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:01:14.507 INFO:teuthology.orchestra.run.smithi063.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-21T07:01:14.507 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether ea:6c:c6:84:62:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:01:14.507 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::e86c:c6ff:fe84:62d4/64 scope link 2024-09-21T07:01:14.507 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-09-21T07:01:14.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:14.508 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T07:01:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-09-21T07:01:14.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:14.571 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-09-21T07:01:14.628 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-09-21T07:01:14.628 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T07:01:14.628 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T07:01:14.628 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T07:01:14.628 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T07:01:14.629 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T07:01:14.629 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-09-21T07:01:14.629 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T07:01:14.629 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T07:01:14.629 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T07:01:14.629 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-09-21T07:01:14.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T07:01:14.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:01:14.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:14.757 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-21T07:01:14.772 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:01:14.773 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:01:14.773 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:01:14.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:14.773 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-09-21T07:01:14.838 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:01:14.839 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T07:01:14.894 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T07:01:14.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T07:01:14.894 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:01:14.950 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-21T07:01:14.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:14.950 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:01:15.045 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:01:15.045 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:01:15.054 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-21T07:01:15.054 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-21T07:01:15.054 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.71:3300,172.21.15.71:3301" 2024-09-21T07:01:15.055 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with new device syntax: 0@2c317557-147d-48e9-8f3c-bb88131d3e37.cephfs=/ 2024-09-21T07:01:15.055 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.63:3300/172.21.15.71:3300/172.21.15.71:3301" will pass to kernel 2024-09-21T07:01:15.055 INFO:teuthology.orchestra.run.smithi063.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T07:01:15.055 INFO:teuthology.orchestra.run.smithi063.stdout: You just mounted a file system that supports labels which does not 2024-09-21T07:01:15.055 INFO:teuthology.orchestra.run.smithi063.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T07:01:15.056 INFO:teuthology.orchestra.run.smithi063.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T07:01:15.056 INFO:teuthology.orchestra.run.smithi063.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T07:01:15.057 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T07:01:15.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:15.057 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T07:01:15.083 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T07:01:15.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T07:01:15.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:01:15.186 INFO:teuthology.orchestra.run.smithi063.stdout:client5029 2024-09-21T07:01:15.187 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:01:15.187 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:01:15.203 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:01:15.204 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:01:15.260 DEBUG:teuthology.orchestra.run.smithi063:> stdin-killer -- python3 -c ' 2024-09-21T07:01:15.260 DEBUG:teuthology.orchestra.run.smithi063:> import os 2024-09-21T07:01:15.260 DEBUG:teuthology.orchestra.run.smithi063:> import uuid 2024-09-21T07:01:15.260 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-21T07:01:15.261 DEBUG:teuthology.orchestra.run.smithi063:> n = 1 2024-09-21T07:01:15.261 DEBUG:teuthology.orchestra.run.smithi063:> create_hard_links = False 2024-09-21T07:01:15.261 DEBUG:teuthology.orchestra.run.smithi063:> if 0 > 0: 2024-09-21T07:01:15.261 DEBUG:teuthology.orchestra.run.smithi063:> create_hard_links = True 2024-09-21T07:01:15.261 DEBUG:teuthology.orchestra.run.smithi063:> path = "/home/ubuntu/cephtest/mnt.0/file_on_fs" 2024-09-21T07:01:15.261 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-21T07:01:15.261 DEBUG:teuthology.orchestra.run.smithi063:> dpath = os.path.dirname(path) 2024-09-21T07:01:15.261 DEBUG:teuthology.orchestra.run.smithi063:> fnameprefix = os.path.basename(path) 2024-09-21T07:01:15.261 DEBUG:teuthology.orchestra.run.smithi063:> os.makedirs(dpath, exist_ok=True) 2024-09-21T07:01:15.261 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-21T07:01:15.262 DEBUG:teuthology.orchestra.run.smithi063:> try: 2024-09-21T07:01:15.262 DEBUG:teuthology.orchestra.run.smithi063:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-21T07:01:15.262 DEBUG:teuthology.orchestra.run.smithi063:> 2024-09-21T07:01:15.262 DEBUG:teuthology.orchestra.run.smithi063:> for i in range(n): 2024-09-21T07:01:15.262 DEBUG:teuthology.orchestra.run.smithi063:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-21T07:01:15.262 DEBUG:teuthology.orchestra.run.smithi063:> with open(fpath, '"'"'w'"'"') as f: 2024-09-21T07:01:15.262 DEBUG:teuthology.orchestra.run.smithi063:> f.write(f"{i}") 2024-09-21T07:01:15.262 DEBUG:teuthology.orchestra.run.smithi063:> if True: 2024-09-21T07:01:15.262 DEBUG:teuthology.orchestra.run.smithi063:> f.flush() 2024-09-21T07:01:15.262 DEBUG:teuthology.orchestra.run.smithi063:> os.fsync(f.fileno()) 2024-09-21T07:01:15.262 DEBUG:teuthology.orchestra.run.smithi063:> if False: 2024-09-21T07:01:15.263 DEBUG:teuthology.orchestra.run.smithi063:> os.unlink(fpath) 2024-09-21T07:01:15.263 DEBUG:teuthology.orchestra.run.smithi063:> if False: 2024-09-21T07:01:15.263 DEBUG:teuthology.orchestra.run.smithi063:> os.fsync(dirfd) 2024-09-21T07:01:15.263 DEBUG:teuthology.orchestra.run.smithi063:> if create_hard_links: 2024-09-21T07:01:15.263 DEBUG:teuthology.orchestra.run.smithi063:> for j in range(0): 2024-09-21T07:01:15.263 DEBUG:teuthology.orchestra.run.smithi063:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-21T07:01:15.263 DEBUG:teuthology.orchestra.run.smithi063:> if False: 2024-09-21T07:01:15.263 DEBUG:teuthology.orchestra.run.smithi063:> os.fsync(dirfd) 2024-09-21T07:01:15.263 DEBUG:teuthology.orchestra.run.smithi063:> finally: 2024-09-21T07:01:15.263 DEBUG:teuthology.orchestra.run.smithi063:> os.close(dirfd) 2024-09-21T07:01:15.264 DEBUG:teuthology.orchestra.run.smithi063:> ' 2024-09-21T07:01:15.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T07:01:15.390 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:01:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.549+0000 7fb1b18ec640 1 -- 172.21.15.63:0/2771486208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003ae0 msgr2=0x7fb194003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.549+0000 7fb1b18ec640 1 --2- 172.21.15.63:0/2771486208 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003ae0 0x7fb194003f50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00bbe0 tx=0x7fb194005830 comp rx=0 tx=0).stop 2024-09-21T07:01:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.549+0000 7fb1ab7fe640 1 -- 172.21.15.63:0/2771486208 reap_dead start 2024-09-21T07:01:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.549+0000 7fb1b18ec640 1 -- 172.21.15.63:0/2771486208 shutdown_connections 2024-09-21T07:01:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.549+0000 7fb1b18ec640 1 -- 172.21.15.63:0/2771486208 >> 172.21.15.63:0/2771486208 conn(0x7fb1ac0b6800 msgr2=0x7fb1ac0b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.549+0000 7fb1b18ec640 1 -- 172.21.15.63:0/2771486208 shutdown_connections 2024-09-21T07:01:15.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.549+0000 7fb1b18ec640 1 -- 172.21.15.63:0/2771486208 wait complete. 2024-09-21T07:01:15.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.551+0000 7fb1b18ec640 1 Processor -- start 2024-09-21T07:01:15.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.551+0000 7fb1b18ec640 1 -- start start 2024-09-21T07:01:15.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.552+0000 7fb1b18ec640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb194003ae0 0x7fb1ac09e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:15.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.552+0000 7fb1b18ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1ac14fb40 0x7fb1ac09edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:15.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.552+0000 7fb1b18ec640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1ac1513f0 0x7fb1ac151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:15.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.552+0000 7fb1b18ec640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac0af3d0 con 0x7fb1ac14fb40 2024-09-21T07:01:15.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.552+0000 7fb1b18ec640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac0b3900 con 0x7fb194003ae0 2024-09-21T07:01:15.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.552+0000 7fb1b18ec640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ac0af550 con 0x7fb1ac1513f0 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.552+0000 7fb1aa7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1ac14fb40 0x7fb1ac09edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.552+0000 7fb1aa7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1ac14fb40 0x7fb1ac09edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51642/0 (socket says 172.21.15.63:51642) 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.552+0000 7fb1aa7fc640 1 -- 172.21.15.63:0/1286079972 learned_addr learned my addr 172.21.15.63:0/1286079972 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.552+0000 7fb1aaffd640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb194003ae0 0x7fb1ac09e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.552+0000 7fb1ab7fe640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1ac1513f0 0x7fb1ac151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.553+0000 7fb1aa7fc640 1 -- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1ac1513f0 msgr2=0x7fb1ac151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.553+0000 7fb1aa7fc640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1ac1513f0 0x7fb1ac151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.553+0000 7fb1aa7fc640 1 -- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb194003ae0 msgr2=0x7fb1ac09e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.553+0000 7fb1aa7fc640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb194003ae0 0x7fb1ac09e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.553+0000 7fb1aa7fc640 1 -- 172.21.15.63:0/1286079972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ac155730 con 0x7fb1ac14fb40 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.553+0000 7fb1aa7fc640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1ac14fb40 0x7fb1ac09edf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0010820 tx=0x7fb1a0010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.553+0000 7fb193fff640 1 -- 172.21.15.63:0/1286079972 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a000ed40 con 0x7fb1ac14fb40 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.553+0000 7fb193fff640 1 -- 172.21.15.63:0/1286079972 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1a001c480 con 0x7fb1ac14fb40 2024-09-21T07:01:15.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.553+0000 7fb193fff640 1 -- 172.21.15.63:0/1286079972 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a001c8b0 con 0x7fb1ac14fb40 2024-09-21T07:01:15.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.553+0000 7fb1b18ec640 1 -- 172.21.15.63:0/1286079972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1ac14f8e0 con 0x7fb1ac14fb40 2024-09-21T07:01:15.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.553+0000 7fb1b18ec640 1 -- 172.21.15.63:0/1286079972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1ac154970 con 0x7fb1ac14fb40 2024-09-21T07:01:15.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.554+0000 7fb1b18ec640 1 -- 172.21.15.63:0/1286079972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1ac06da90 con 0x7fb1ac14fb40 2024-09-21T07:01:15.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.555+0000 7fb193fff640 1 -- 172.21.15.63:0/1286079972 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1a001ca50 con 0x7fb1ac14fb40 2024-09-21T07:01:15.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.555+0000 7fb193fff640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb198078bc0 0x7fb19807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:15.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.556+0000 7fb193fff640 1 -- 172.21.15.63:0/1286079972 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb1a009b950 con 0x7fb1ac14fb40 2024-09-21T07:01:15.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.556+0000 7fb1aaffd640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb198078bc0 0x7fb19807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:15.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.556+0000 7fb1aaffd640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb198078bc0 0x7fb19807b0d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb19c035000 tx=0x7fb19c0046c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:15.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.560+0000 7fb193fff640 1 -- 172.21.15.63:0/1286079972 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb1a0063860 con 0x7fb1ac14fb40 2024-09-21T07:01:15.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.788+0000 7fb1b18ec640 1 -- 172.21.15.63:0/1286079972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb1ac076420 con 0x7fb1ac14fb40 2024-09-21T07:01:15.790 INFO:tasks.ceph.mon.a.smithi063.stderr:2024-09-21T07:01:15.789+0000 7fed43401640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:01:15.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.790+0000 7fb193fff640 1 -- 172.21.15.63:0/1286079972 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7fb1a0068290 con 0x7fb1ac14fb40 2024-09-21T07:01:15.792 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:01:15.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.793+0000 7fb1b18ec640 1 -- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb198078bc0 msgr2=0x7fb19807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:15.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.793+0000 7fb1b18ec640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb198078bc0 0x7fb19807b0d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb19c035000 tx=0x7fb19c0046c0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.793+0000 7fb1b18ec640 1 -- 172.21.15.63:0/1286079972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1ac14fb40 msgr2=0x7fb1ac09edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:15.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.793+0000 7fb1b18ec640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1ac14fb40 0x7fb1ac09edf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0010820 tx=0x7fb1a0010ce0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.793+0000 7fb1b18ec640 1 -- 172.21.15.63:0/1286079972 shutdown_connections 2024-09-21T07:01:15.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.793+0000 7fb1b18ec640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb198078bc0 0x7fb19807b0d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.793+0000 7fb1b18ec640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb1ac1513f0 0x7fb1ac151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.793+0000 7fb1b18ec640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb1ac14fb40 0x7fb1ac09edf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.793+0000 7fb1b18ec640 1 --2- 172.21.15.63:0/1286079972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb194003ae0 0x7fb1ac09e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.793+0000 7fb1b18ec640 1 -- 172.21.15.63:0/1286079972 >> 172.21.15.63:0/1286079972 conn(0x7fb1ac0b6800 msgr2=0x7fb1ac15c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:15.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.793+0000 7fb1b18ec640 1 -- 172.21.15.63:0/1286079972 shutdown_connections 2024-09-21T07:01:15.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.793+0000 7fb1b18ec640 1 -- 172.21.15.63:0/1286079972 wait complete. 2024-09-21T07:01:15.797 INFO:tasks.ceph.mds.a.smithi063.stderr: -2212> 2024-09-21T07:01:08.755+0000 7eff8a0dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:01:15.807 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:01:15.852 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2024-09-21T07:01:15.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.926+0000 7fa75bd5e640 1 -- 172.21.15.63:0/1752264883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa75415ef00 msgr2=0x7fa7540d2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:15.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.926+0000 7fa75bd5e640 1 --2- 172.21.15.63:0/1752264883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa75415ef00 0x7fa7540d2a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa744005fd0 tx=0x7fa74402a5d0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.926+0000 7fa75bd5e640 1 -- 172.21.15.63:0/1752264883 shutdown_connections 2024-09-21T07:01:15.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.926+0000 7fa75bd5e640 1 --2- 172.21.15.63:0/1752264883 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa75415ef00 0x7fa7540d2a70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.926+0000 7fa75bd5e640 1 --2- 172.21.15.63:0/1752264883 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7540b7530 0x7fa7540d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.926+0000 7fa75bd5e640 1 -- 172.21.15.63:0/1752264883 >> 172.21.15.63:0/1752264883 conn(0x7fa75408bfd0 msgr2=0x7fa7540d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:15.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.926+0000 7fa75bd5e640 1 -- 172.21.15.63:0/1752264883 shutdown_connections 2024-09-21T07:01:15.928 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.926+0000 7fa75bd5e640 1 -- 172.21.15.63:0/1752264883 wait complete. 2024-09-21T07:01:15.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.927+0000 7fa75bd5e640 1 Processor -- start 2024-09-21T07:01:15.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.927+0000 7fa75bd5e640 1 -- start start 2024-09-21T07:01:15.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa75bd5e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7540b2650 0x7fa7540c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:15.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa75bd5e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7540b7530 0x7fa754152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa75bd5e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa75415ef00 0x7fa7541618b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa75bd5e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa7540b3500 con 0x7fa7540b7530 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa75bd5e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa7540b3380 con 0x7fa75415ef00 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa75bd5e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa7540d0320 con 0x7fa7540b2650 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa7592f9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7540b7530 0x7fa754152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa7592f9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7540b7530 0x7fa754152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51678/0 (socket says 172.21.15.63:51678) 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa7592f9640 1 -- 172.21.15.63:0/4201820769 learned_addr learned my addr 172.21.15.63:0/4201820769 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa759afa640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7540b2650 0x7fa7540c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa75a2fb640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa75415ef00 0x7fa7541618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa7592f9640 1 -- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7540b2650 msgr2=0x7fa7540c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa7592f9640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7540b2650 0x7fa7540c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa7592f9640 1 -- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa75415ef00 msgr2=0x7fa7541618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa7592f9640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa75415ef00 0x7fa7541618b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:15.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa7592f9640 1 -- 172.21.15.63:0/4201820769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7540b4480 con 0x7fa7540b7530 2024-09-21T07:01:15.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.929+0000 7fa7592f9640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7540b7530 0x7fa754152270 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa744034040 tx=0x7fa7440035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:15.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.930+0000 7fa74a7fc640 1 -- 172.21.15.63:0/4201820769 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74403e030 con 0x7fa7540b7530 2024-09-21T07:01:15.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.930+0000 7fa74a7fc640 1 -- 172.21.15.63:0/4201820769 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa744003ae0 con 0x7fa7540b7530 2024-09-21T07:01:15.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.930+0000 7fa75bd5e640 1 -- 172.21.15.63:0/4201820769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7540b4760 con 0x7fa7540b7530 2024-09-21T07:01:15.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.930+0000 7fa74a7fc640 1 -- 172.21.15.63:0/4201820769 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744035040 con 0x7fa7540b7530 2024-09-21T07:01:15.933 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.930+0000 7fa75bd5e640 1 -- 172.21.15.63:0/4201820769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa754161390 con 0x7fa7540b7530 2024-09-21T07:01:15.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.931+0000 7fa75bd5e640 1 -- 172.21.15.63:0/4201820769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7540d0860 con 0x7fa7540b7530 2024-09-21T07:01:15.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.931+0000 7fa74a7fc640 1 -- 172.21.15.63:0/4201820769 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa744041030 con 0x7fa7540b7530 2024-09-21T07:01:15.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.932+0000 7fa74a7fc640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa738078bc0 0x7fa73807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:15.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.932+0000 7fa74a7fc640 1 -- 172.21.15.63:0/4201820769 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7fa7440bb1a0 con 0x7fa7540b7530 2024-09-21T07:01:15.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.932+0000 7fa759afa640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa738078bc0 0x7fa73807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:15.934 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.933+0000 7fa759afa640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa738078bc0 0x7fa73807b0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7540d4660 tx=0x7fa750005f30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:15.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:15.936+0000 7fa74a7fc640 1 -- 172.21.15.63:0/4201820769 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa744082fc0 con 0x7fa7540b7530 2024-09-21T07:01:16.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.166+0000 7fa75bd5e640 1 -- 172.21.15.63:0/4201820769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa7540b6fc0 con 0x7fa7540b7530 2024-09-21T07:01:16.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.821+0000 7fa74a7fc640 1 -- 172.21.15.63:0/4201820769 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7fa7440879f0 con 0x7fa7540b7530 2024-09-21T07:01:16.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.824+0000 7fa75bd5e640 1 -- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa738078bc0 msgr2=0x7fa73807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:16.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.824+0000 7fa75bd5e640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa738078bc0 0x7fa73807b0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa7540d4660 tx=0x7fa750005f30 comp rx=0 tx=0).stop 2024-09-21T07:01:16.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.824+0000 7fa75bd5e640 1 -- 172.21.15.63:0/4201820769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7540b7530 msgr2=0x7fa754152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:16.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.824+0000 7fa75bd5e640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7540b7530 0x7fa754152270 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa744034040 tx=0x7fa7440035f0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.824+0000 7fa75bd5e640 1 -- 172.21.15.63:0/4201820769 shutdown_connections 2024-09-21T07:01:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.824+0000 7fa75bd5e640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa738078bc0 0x7fa73807b0d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.824+0000 7fa75bd5e640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa75415ef00 0x7fa7541618b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.824+0000 7fa75bd5e640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa7540b7530 0x7fa754152270 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.824+0000 7fa75bd5e640 1 --2- 172.21.15.63:0/4201820769 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa7540b2650 0x7fa7540c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.824+0000 7fa75bd5e640 1 -- 172.21.15.63:0/4201820769 >> 172.21.15.63:0/4201820769 conn(0x7fa75408bfd0 msgr2=0x7fa7540d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.824+0000 7fa75bd5e640 1 -- 172.21.15.63:0/4201820769 shutdown_connections 2024-09-21T07:01:16.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.824+0000 7fa75bd5e640 1 -- 172.21.15.63:0/4201820769 wait complete. 2024-09-21T07:01:16.840 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --recover --force --fscid 2 2024-09-21T07:01:16.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.971+0000 7f3d0a225640 1 -- 172.21.15.63:0/758915397 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3d040cf310 msgr2=0x7f3d040cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:16.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.971+0000 7f3d0a225640 1 --2- 172.21.15.63:0/758915397 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3d040cf310 0x7f3d040cf720 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc005fd0 tx=0x7f3cfc02aa90 comp rx=0 tx=0).stop 2024-09-21T07:01:16.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.971+0000 7f3d0a225640 1 -- 172.21.15.63:0/758915397 shutdown_connections 2024-09-21T07:01:16.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.971+0000 7f3d0a225640 1 --2- 172.21.15.63:0/758915397 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3d040cf310 0x7f3d040cf720 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.971+0000 7f3d0a225640 1 --2- 172.21.15.63:0/758915397 >> v2:172.21.15.71:3300/0 conn(0x7f3d0415ef00 0x7f3d040d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.971+0000 7f3d0a225640 1 -- 172.21.15.63:0/758915397 >> 172.21.15.63:0/758915397 conn(0x7f3d0408bfd0 msgr2=0x7f3d040d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:16.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.971+0000 7f3d0a225640 1 -- 172.21.15.63:0/758915397 shutdown_connections 2024-09-21T07:01:16.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.971+0000 7f3d0a225640 1 -- 172.21.15.63:0/758915397 wait complete. 2024-09-21T07:01:16.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.973+0000 7f3d0a225640 1 Processor -- start 2024-09-21T07:01:16.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.973+0000 7f3d0a225640 1 -- start start 2024-09-21T07:01:16.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.974+0000 7f3d0a225640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3d040b7530 0x7f3d041f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.974+0000 7f3d0a225640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d040cf310 0x7f3d04161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.974+0000 7f3d0a225640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d0415ef00 0x7f3d04161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.974+0000 7f3d0a225640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3d040cfff0 con 0x7f3d0415ef00 2024-09-21T07:01:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.974+0000 7f3d0a225640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3d040cfe70 con 0x7f3d040cf310 2024-09-21T07:01:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.974+0000 7f3d0a225640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3d040d0170 con 0x7f3d040b7530 2024-09-21T07:01:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.974+0000 7f3d03fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d0415ef00 0x7f3d04161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.974+0000 7f3d03fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d0415ef00 0x7f3d04161550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51686/0 (socket says 172.21.15.63:51686) 2024-09-21T07:01:16.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.974+0000 7f3d03fff640 1 -- 172.21.15.63:0/1631827721 learned_addr learned my addr 172.21.15.63:0/1631827721 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.975+0000 7f3d037fe640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3d040b7530 0x7f3d041f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.975+0000 7f3d02ffd640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d040cf310 0x7f3d04161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.975+0000 7f3d03fff640 1 -- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3d040b7530 msgr2=0x7f3d041f9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.975+0000 7f3d03fff640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3d040b7530 0x7f3d041f9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.975+0000 7f3d03fff640 1 -- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d040cf310 msgr2=0x7f3d04161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.975+0000 7f3d03fff640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d040cf310 0x7f3d04161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.975+0000 7f3d03fff640 1 -- 172.21.15.63:0/1631827721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d040b3c40 con 0x7f3d0415ef00 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.975+0000 7f3d03fff640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d0415ef00 0x7f3d04161550 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009bf0 tx=0x7f3cfc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.975+0000 7f3cebfff640 1 -- 172.21.15.63:0/1631827721 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc044070 con 0x7f3d0415ef00 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.975+0000 7f3cebfff640 1 -- 172.21.15.63:0/1631827721 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cfc004040 con 0x7f3d0415ef00 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.975+0000 7f3d0a225640 1 -- 172.21.15.63:0/1631827721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d040b3f20 con 0x7f3d0415ef00 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.975+0000 7f3cebfff640 1 -- 172.21.15.63:0/1631827721 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc004450 con 0x7f3d0415ef00 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.975+0000 7f3d0a225640 1 -- 172.21.15.63:0/1631827721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d040b44e0 con 0x7f3d0415ef00 2024-09-21T07:01:16.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.976+0000 7f3d0a225640 1 -- 172.21.15.63:0/1631827721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d040d0a60 con 0x7f3d0415ef00 2024-09-21T07:01:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.977+0000 7f3cebfff640 1 -- 172.21.15.63:0/1631827721 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3cfc047070 con 0x7f3d0415ef00 2024-09-21T07:01:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.978+0000 7f3cebfff640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3cf0078b90 0x7f3cf007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.978+0000 7f3cebfff640 1 -- 172.21.15.63:0/1631827721 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5795+0+0 (secure 0 0 0) 0x7f3cfc0bbc90 con 0x7f3d0415ef00 2024-09-21T07:01:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.978+0000 7f3d037fe640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3cf0078b90 0x7f3cf007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:16.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.978+0000 7f3d037fe640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3cf0078b90 0x7f3cf007b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3d040d4660 tx=0x7f3cf4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:16.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:16.982+0000 7f3cebfff640 1 -- 172.21.15.63:0/1631827721 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3d040d0a60 con 0x7f3d0415ef00 2024-09-21T07:01:17.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.209+0000 7f3d0a225640 1 -- 172.21.15.63:0/1631827721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "recover": true, "force": true, "fscid": 2} v 0) -- 0x7f3d040d0700 con 0x7f3d0415ef00 2024-09-21T07:01:17.823 INFO:tasks.ceph.mon.a.smithi063.stderr:2024-09-21T07:01:17.822+0000 7fed45c06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:01:17.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.823+0000 7f3cebfff640 1 -- 172.21.15.63:0/1631827721 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "recover": true, "force": true, "fscid": 2}]=0 new fs with metadata pool 4 and data pool 5 v20) ==== 216+0+0 (secure 0 0 0) 0x7f3cfc032030 con 0x7f3d0415ef00 2024-09-21T07:01:17.824 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 4 and data pool 5 2024-09-21T07:01:17.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.826+0000 7f3d0a225640 1 -- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3cf0078b90 msgr2=0x7f3cf007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.826+0000 7f3d0a225640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3cf0078b90 0x7f3cf007b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3d040d4660 tx=0x7f3cf4009040 comp rx=0 tx=0).stop 2024-09-21T07:01:17.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.826+0000 7f3d0a225640 1 -- 172.21.15.63:0/1631827721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d0415ef00 msgr2=0x7f3d04161550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.826+0000 7f3d0a225640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d0415ef00 0x7f3d04161550 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009bf0 tx=0x7f3cfc003ba0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.826+0000 7f3d0a225640 1 -- 172.21.15.63:0/1631827721 shutdown_connections 2024-09-21T07:01:17.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.827+0000 7f3d0a225640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3cf0078b90 0x7f3cf007b0a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.827+0000 7f3d0a225640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d0415ef00 0x7f3d04161550 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.827+0000 7f3d0a225640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3d040cf310 0x7f3d04161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.827+0000 7f3d0a225640 1 --2- 172.21.15.63:0/1631827721 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3d040b7530 0x7f3d041f9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.827+0000 7f3d0a225640 1 -- 172.21.15.63:0/1631827721 >> 172.21.15.63:0/1631827721 conn(0x7f3d0408bfd0 msgr2=0x7f3d0406e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:17.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.827+0000 7f3d0a225640 1 -- 172.21.15.63:0/1631827721 shutdown_connections 2024-09-21T07:01:17.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.827+0000 7f3d0a225640 1 -- 172.21.15.63:0/1631827721 wait complete. 2024-09-21T07:01:17.842 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-09-21T07:01:17.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.964+0000 7f5114ede640 1 -- 172.21.15.63:0/2597915094 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51100b52a0 msgr2=0x7f51100b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.964+0000 7f5114ede640 1 --2- 172.21.15.63:0/2597915094 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51100b52a0 0x7f51100b56b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009830 tx=0x7f50f802a480 comp rx=0 tx=0).stop 2024-09-21T07:01:17.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.964+0000 7f5114ede640 1 -- 172.21.15.63:0/2597915094 shutdown_connections 2024-09-21T07:01:17.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.964+0000 7f5114ede640 1 --2- 172.21.15.63:0/2597915094 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51100b52a0 0x7f51100b56b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.964+0000 7f5114ede640 1 -- 172.21.15.63:0/2597915094 >> 172.21.15.63:0/2597915094 conn(0x7f51100ceed0 msgr2=0x7f51100cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:17.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.964+0000 7f5114ede640 1 -- 172.21.15.63:0/2597915094 shutdown_connections 2024-09-21T07:01:17.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.964+0000 7f5114ede640 1 -- 172.21.15.63:0/2597915094 wait complete. 2024-09-21T07:01:17.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.966+0000 7f5114ede640 1 Processor -- start 2024-09-21T07:01:17.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.966+0000 7f5114ede640 1 -- start start 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f5114ede640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51100b52a0 0x7f51100cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f5114ede640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51100cd0b0 0x7f51101538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f5114ede640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51100d0350 0x7f51101f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f5114ede640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5110074610 con 0x7f51100d0350 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f5114ede640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f51100d1400 con 0x7f51100cd0b0 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f5114ede640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f51100b5bf0 con 0x7f51100b52a0 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f510ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51100d0350 0x7f51101f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f510ed9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51100d0350 0x7f51101f6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51700/0 (socket says 172.21.15.63:51700) 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f510ed9d640 1 -- 172.21.15.63:0/2894749512 learned_addr learned my addr 172.21.15.63:0/2894749512 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f510dd9b640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51100cd0b0 0x7f51101538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f510e59c640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51100b52a0 0x7f51100cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f510ed9d640 1 -- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51100b52a0 msgr2=0x7f51100cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f510ed9d640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51100b52a0 0x7f51100cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f510ed9d640 1 -- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51100cd0b0 msgr2=0x7f51101538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:17.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f510ed9d640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51100cd0b0 0x7f51101538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:17.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f510ed9d640 1 -- 172.21.15.63:0/2894749512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5110160510 con 0x7f51100d0350 2024-09-21T07:01:17.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f510ed9d640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51100d0350 0x7f51101f6f50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f510000b440 tx=0x7f510000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:17.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.968+0000 7f5106ffd640 1 -- 172.21.15.63:0/2894749512 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100011830 con 0x7f51100d0350 2024-09-21T07:01:17.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.969+0000 7f5106ffd640 1 -- 172.21.15.63:0/2894749512 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5100016070 con 0x7f51100d0350 2024-09-21T07:01:17.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.969+0000 7f5106ffd640 1 -- 172.21.15.63:0/2894749512 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100011d60 con 0x7f51100d0350 2024-09-21T07:01:17.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.969+0000 7f5114ede640 1 -- 172.21.15.63:0/2894749512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51101607f0 con 0x7f51100d0350 2024-09-21T07:01:17.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.969+0000 7f5114ede640 1 -- 172.21.15.63:0/2894749512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51101f5380 con 0x7f51100d0350 2024-09-21T07:01:17.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.970+0000 7f5114ede640 1 -- 172.21.15.63:0/2894749512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51100b75e0 con 0x7f51100d0350 2024-09-21T07:01:17.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.970+0000 7f5106ffd640 1 -- 172.21.15.63:0/2894749512 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f510001b460 con 0x7f51100d0350 2024-09-21T07:01:17.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.971+0000 7f5106ffd640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f50f0078bc0 0x7f50f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:17.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.971+0000 7f5106ffd640 1 -- 172.21.15.63:0/2894749512 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f510009a5f0 con 0x7f51100d0350 2024-09-21T07:01:17.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.971+0000 7f510e59c640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f50f0078bc0 0x7f50f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:17.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.972+0000 7f510e59c640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f50f0078bc0 0x7f50f007b0d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5108001410 tx=0x7f5108009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:17.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:17.976+0000 7f5106ffd640 1 -- 172.21.15.63:0/2894749512 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5100020020 con 0x7f51100d0350 2024-09-21T07:01:18.065 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:01:18.067 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:01:18.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.203+0000 7f5114ede640 1 -- 172.21.15.63:0/2894749512 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f51101602a0 con 0x7f51100d0350 2024-09-21T07:01:18.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.838+0000 7f5106ffd640 1 -- 172.21.15.63:0/2894749512 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v21) ==== 162+0+0 (secure 0 0 0) 0x7f5100062410 con 0x7f51100d0350 2024-09-21T07:01:18.840 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked joinable; MDS may join as newly active. 2024-09-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.841+0000 7f5114ede640 1 -- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f50f0078bc0 msgr2=0x7f50f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.841+0000 7f5114ede640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f50f0078bc0 0x7f50f007b0d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5108001410 tx=0x7f5108009040 comp rx=0 tx=0).stop 2024-09-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.841+0000 7f5114ede640 1 -- 172.21.15.63:0/2894749512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51100d0350 msgr2=0x7f51101f6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.841+0000 7f5114ede640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51100d0350 0x7f51101f6f50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f510000b440 tx=0x7f510000b900 comp rx=0 tx=0).stop 2024-09-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.841+0000 7f5114ede640 1 -- 172.21.15.63:0/2894749512 shutdown_connections 2024-09-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.841+0000 7f5114ede640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f50f0078bc0 0x7f50f007b0d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.841+0000 7f5114ede640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51100d0350 0x7f51101f6f50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.841+0000 7f5114ede640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51100cd0b0 0x7f51101538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.841+0000 7f5114ede640 1 --2- 172.21.15.63:0/2894749512 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51100b52a0 0x7f51100cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.841+0000 7f5114ede640 1 -- 172.21.15.63:0/2894749512 >> 172.21.15.63:0/2894749512 conn(0x7f51100ceed0 msgr2=0x7f51100760d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.841+0000 7f5114ede640 1 -- 172.21.15.63:0/2894749512 shutdown_connections 2024-09-21T07:01:18.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.841+0000 7f5114ede640 1 -- 172.21.15.63:0/2894749512 wait complete. 2024-09-21T07:01:18.857 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:01:18.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.973+0000 7f73b07da640 1 -- 172.21.15.63:0/2079881319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a80c61e0 msgr2=0x7f73a80b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:18.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.973+0000 7f73b07da640 1 --2- 172.21.15.63:0/2079881319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a80c61e0 0x7f73a80b27a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f73a80c7130 tx=0x7f73a402a510 comp rx=0 tx=0).stop 2024-09-21T07:01:18.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.973+0000 7f73b07da640 1 -- 172.21.15.63:0/2079881319 shutdown_connections 2024-09-21T07:01:18.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.973+0000 7f73b07da640 1 --2- 172.21.15.63:0/2079881319 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73a80cfd50 0x7f73a80b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.973+0000 7f73b07da640 1 --2- 172.21.15.63:0/2079881319 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a80c61e0 0x7f73a80b27a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.973+0000 7f73b07da640 1 -- 172.21.15.63:0/2079881319 >> 172.21.15.63:0/2079881319 conn(0x7f73a80b2f70 msgr2=0x7f73a80b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:18.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.974+0000 7f73b07da640 1 -- 172.21.15.63:0/2079881319 shutdown_connections 2024-09-21T07:01:18.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.974+0000 7f73b07da640 1 -- 172.21.15.63:0/2079881319 wait complete. 2024-09-21T07:01:18.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.975+0000 7f73b07da640 1 Processor -- start 2024-09-21T07:01:18.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.975+0000 7f73b07da640 1 -- start start 2024-09-21T07:01:18.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73b07da640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73a80b4270 0x7f73a80ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73b07da640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73a80c61e0 0x7f73a81f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73b07da640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a80cfd50 0x7f73a815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73b07da640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f73a80b1520 con 0x7f73a80cfd50 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73b07da640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73a80b13a0 con 0x7f73a80c61e0 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73b07da640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f73a80b16a0 con 0x7f73a80b4270 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73aed77640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a80cfd50 0x7f73a815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73aed77640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a80cfd50 0x7f73a815ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38102/0 (socket says 172.21.15.63:38102) 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73aed77640 1 -- 172.21.15.63:0/1892337743 learned_addr learned my addr 172.21.15.63:0/1892337743 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73ae576640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73a80b4270 0x7f73a80ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73add75640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73a80c61e0 0x7f73a81f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73aed77640 1 -- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73a80b4270 msgr2=0x7f73a80ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73aed77640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73a80b4270 0x7f73a80ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73aed77640 1 -- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73a80c61e0 msgr2=0x7f73a81f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:18.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73aed77640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73a80c61e0 0x7f73a81f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:18.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73aed77640 1 -- 172.21.15.63:0/1892337743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a815ad30 con 0x7f73a80cfd50 2024-09-21T07:01:18.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73add75640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73a80c61e0 0x7f73a81f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:18.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73aed77640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a80cfd50 0x7f73a815ca90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f73a000ea10 tx=0x7f73a000eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:18.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f739effd640 1 -- 172.21.15.63:0/1892337743 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a000cde0 con 0x7f73a80cfd50 2024-09-21T07:01:18.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f739effd640 1 -- 172.21.15.63:0/1892337743 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73a0004c10 con 0x7f73a80cfd50 2024-09-21T07:01:18.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73b07da640 1 -- 172.21.15.63:0/1892337743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a815b010 con 0x7f73a80cfd50 2024-09-21T07:01:18.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f739effd640 1 -- 172.21.15.63:0/1892337743 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a0005020 con 0x7f73a80cfd50 2024-09-21T07:01:18.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.977+0000 7f73b07da640 1 -- 172.21.15.63:0/1892337743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a815b5d0 con 0x7f73a80cfd50 2024-09-21T07:01:18.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.978+0000 7f73b07da640 1 -- 172.21.15.63:0/1892337743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a80b27a0 con 0x7f73a80cfd50 2024-09-21T07:01:18.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.979+0000 7f739effd640 1 -- 172.21.15.63:0/1892337743 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f73a00051c0 con 0x7f73a80cfd50 2024-09-21T07:01:18.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.980+0000 7f739effd640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f738c078b90 0x7f738c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:18.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.980+0000 7f739effd640 1 -- 172.21.15.63:0/1892337743 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f73a009c0e0 con 0x7f73a80cfd50 2024-09-21T07:01:18.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.980+0000 7f73ae576640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f738c078b90 0x7f738c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:18.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.981+0000 7f73ae576640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f738c078b90 0x7f738c07b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73a4034000 tx=0x7f73a4004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:18.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:18.984+0000 7f739effd640 1 -- 172.21.15.63:0/1892337743 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f73a0026020 con 0x7f73a80cfd50 2024-09-21T07:01:19.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.207+0000 7f73b07da640 1 -- 172.21.15.63:0/1892337743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73a815aaa0 con 0x7f73a80cfd50 2024-09-21T07:01:19.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.208+0000 7f739effd640 1 -- 172.21.15.63:0/1892337743 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5213 (secure 0 0 0) 0x7f73a0064630 con 0x7f73a80cfd50 2024-09-21T07:01:19.209 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:19.210 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":22,"btime":"2024-09-21T07:01:18:841557+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/585708774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":585708774},{"type":"v1","addr":"172.21.15.71:6836","nonce":585708774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4837,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2545148827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":2545148827},{"type":"v1","addr":"172.21.15.71:6837","nonce":2545148827}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/2618757202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2618757202},{"type":"v1","addr":"172.21.15.63:6834","nonce":2618757202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:01:17.210494+0000","modified":"2024-09-21T07:01:18.841538+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":22,"state":"up:replay","state_seq":1,"addr":"172.21.15.63:6835/2711820189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2711820189},{"type":"v1","addr":"172.21.15.63:6835","nonce":2711820189}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-21T07:01:19.210 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 22 2024-09-21T07:01:19.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.210+0000 7f73b07da640 1 -- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f738c078b90 msgr2=0x7f738c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:19.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.210+0000 7f73b07da640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f738c078b90 0x7f738c07b0a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73a4034000 tx=0x7f73a4004730 comp rx=0 tx=0).stop 2024-09-21T07:01:19.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.210+0000 7f73b07da640 1 -- 172.21.15.63:0/1892337743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a80cfd50 msgr2=0x7f73a815ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:19.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.210+0000 7f73b07da640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a80cfd50 0x7f73a815ca90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f73a000ea10 tx=0x7f73a000eed0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.210+0000 7f73b07da640 1 -- 172.21.15.63:0/1892337743 shutdown_connections 2024-09-21T07:01:19.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.210+0000 7f73b07da640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f738c078b90 0x7f738c07b0a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.210+0000 7f73b07da640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f73a80cfd50 0x7f73a815ca90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.210+0000 7f73b07da640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73a80c61e0 0x7f73a81f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.210+0000 7f73b07da640 1 --2- 172.21.15.63:0/1892337743 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f73a80b4270 0x7f73a80ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:19.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.210+0000 7f73b07da640 1 -- 172.21.15.63:0/1892337743 >> 172.21.15.63:0/1892337743 conn(0x7f73a80b2f70 msgr2=0x7f73a80cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:19.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.210+0000 7f73b07da640 1 -- 172.21.15.63:0/1892337743 shutdown_connections 2024-09-21T07:01:19.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:19.210+0000 7f73b07da640 1 -- 172.21.15.63:0/1892337743 wait complete. 2024-09-21T07:01:19.626 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:01:17.210494+0000', 'modified': '2024-09-21T07:01:18.841538+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5103': {'gid': 5103, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.63:6835/2711820189', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6833', 'nonce': 2711820189}, {'type': 'v1', 'addr': '172.21.15.63:6835', 'nonce': 2711820189}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-21T07:01:19.626 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5103:up:replay 2024-09-21T07:01:20.627 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:01:20.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.757+0000 7fc37f95e640 1 -- 172.21.15.63:0/1791434335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37815ef00 msgr2=0x7fc3780d2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:20.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.757+0000 7fc37f95e640 1 --2- 172.21.15.63:0/1791434335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37815ef00 0x7fc3780d2a70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc374009830 tx=0x7fc37402a510 comp rx=0 tx=0).stop 2024-09-21T07:01:20.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.757+0000 7fc37f95e640 1 -- 172.21.15.63:0/1791434335 shutdown_connections 2024-09-21T07:01:20.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.757+0000 7fc37f95e640 1 --2- 172.21.15.63:0/1791434335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37815ef00 0x7fc3780d2a70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.757+0000 7fc37f95e640 1 --2- 172.21.15.63:0/1791434335 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3780b7530 0x7fc3780d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.757+0000 7fc37f95e640 1 -- 172.21.15.63:0/1791434335 >> 172.21.15.63:0/1791434335 conn(0x7fc37808bfd0 msgr2=0x7fc3780d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:20.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.757+0000 7fc37f95e640 1 -- 172.21.15.63:0/1791434335 shutdown_connections 2024-09-21T07:01:20.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.757+0000 7fc37f95e640 1 -- 172.21.15.63:0/1791434335 wait complete. 2024-09-21T07:01:20.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.759+0000 7fc37f95e640 1 Processor -- start 2024-09-21T07:01:20.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.759+0000 7fc37f95e640 1 -- start start 2024-09-21T07:01:20.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37f95e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3780b2650 0x7fc3780cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:20.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37f95e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3780b7530 0x7fc3781611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37f95e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37815ef00 0x7fc378161710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37f95e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc3780b3500 con 0x7fc37815ef00 2024-09-21T07:01:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37f95e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3780b3380 con 0x7fc3780b2650 2024-09-21T07:01:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37f95e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc3780d0320 con 0x7fc3780b7530 2024-09-21T07:01:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37defb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37815ef00 0x7fc378161710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:20.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37defb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37815ef00 0x7fc378161710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38126/0 (socket says 172.21.15.63:38126) 2024-09-21T07:01:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37defb640 1 -- 172.21.15.63:0/3387143380 learned_addr learned my addr 172.21.15.63:0/3387143380 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37cef9640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3780b7530 0x7fc3781611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37d6fa640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3780b2650 0x7fc3780cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37defb640 1 -- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3780b7530 msgr2=0x7fc3781611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37defb640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3780b7530 0x7fc3781611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37defb640 1 -- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3780b2650 msgr2=0x7fc3780cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:20.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.760+0000 7fc37defb640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3780b2650 0x7fc3780cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.761+0000 7fc37defb640 1 -- 172.21.15.63:0/3387143380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3780ce740 con 0x7fc37815ef00 2024-09-21T07:01:20.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.761+0000 7fc37defb640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37815ef00 0x7fc378161710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc37000ca20 tx=0x7fc37000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:20.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.761+0000 7fc369ffb640 1 -- 172.21.15.63:0/3387143380 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370016020 con 0x7fc37815ef00 2024-09-21T07:01:20.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.761+0000 7fc369ffb640 1 -- 172.21.15.63:0/3387143380 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc37000acc0 con 0x7fc37815ef00 2024-09-21T07:01:20.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.761+0000 7fc37f95e640 1 -- 172.21.15.63:0/3387143380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3780cbdf0 con 0x7fc37815ef00 2024-09-21T07:01:20.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.761+0000 7fc369ffb640 1 -- 172.21.15.63:0/3387143380 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370012680 con 0x7fc37815ef00 2024-09-21T07:01:20.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.761+0000 7fc37f95e640 1 -- 172.21.15.63:0/3387143380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3780cd9a0 con 0x7fc37815ef00 2024-09-21T07:01:20.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.762+0000 7fc37f95e640 1 -- 172.21.15.63:0/3387143380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3780d0860 con 0x7fc37815ef00 2024-09-21T07:01:20.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.763+0000 7fc369ffb640 1 -- 172.21.15.63:0/3387143380 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc370019020 con 0x7fc37815ef00 2024-09-21T07:01:20.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.764+0000 7fc369ffb640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc35c078b90 0x7fc35c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:20.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.764+0000 7fc369ffb640 1 -- 172.21.15.63:0/3387143380 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fc37009b250 con 0x7fc37815ef00 2024-09-21T07:01:20.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.764+0000 7fc37d6fa640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc35c078b90 0x7fc35c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:20.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.765+0000 7fc37d6fa640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc35c078b90 0x7fc35c07b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3780d4660 tx=0x7fc36c00b2e0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:20.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.769+0000 7fc369ffb640 1 -- 172.21.15.63:0/3387143380 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc370020020 con 0x7fc37815ef00 2024-09-21T07:01:20.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.994+0000 7fc37f95e640 1 -- 172.21.15.63:0/3387143380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc37806a130 con 0x7fc37815ef00 2024-09-21T07:01:20.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.994+0000 7fc369ffb640 1 -- 172.21.15.63:0/3387143380 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5213 (secure 0 0 0) 0x7fc370062fe0 con 0x7fc37815ef00 2024-09-21T07:01:20.996 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":24,"btime":"2024-09-21T07:01:20:844516+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/585708774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":585708774},{"type":"v1","addr":"172.21.15.71:6836","nonce":585708774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4837,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2545148827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":2545148827},{"type":"v1","addr":"172.21.15.71:6837","nonce":2545148827}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/2618757202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2618757202},{"type":"v1","addr":"172.21.15.63:6834","nonce":2618757202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:01:17.210494+0000","modified":"2024-09-21T07:01:19.847965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":22,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.63:6835/2711820189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2711820189},{"type":"v1","addr":"172.21.15.63:6835","nonce":2711820189}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-21T07:01:20.997 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 24 2024-09-21T07:01:20.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.996+0000 7fc37f95e640 1 -- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc35c078b90 msgr2=0x7fc35c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:20.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.996+0000 7fc37f95e640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc35c078b90 0x7fc35c07b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3780d4660 tx=0x7fc36c00b2e0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.996+0000 7fc37f95e640 1 -- 172.21.15.63:0/3387143380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37815ef00 msgr2=0x7fc378161710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:20.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.996+0000 7fc37f95e640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37815ef00 0x7fc378161710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc37000ca20 tx=0x7fc37000cee0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.997+0000 7fc37f95e640 1 -- 172.21.15.63:0/3387143380 shutdown_connections 2024-09-21T07:01:20.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.997+0000 7fc37f95e640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc35c078b90 0x7fc35c07b0a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.997+0000 7fc37f95e640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc37815ef00 0x7fc378161710 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.997+0000 7fc37f95e640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc3780b7530 0x7fc3781611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.997+0000 7fc37f95e640 1 --2- 172.21.15.63:0/3387143380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3780b2650 0x7fc3780cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:20.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.997+0000 7fc37f95e640 1 -- 172.21.15.63:0/3387143380 >> 172.21.15.63:0/3387143380 conn(0x7fc37808bfd0 msgr2=0x7fc3780d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:20.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.997+0000 7fc37f95e640 1 -- 172.21.15.63:0/3387143380 shutdown_connections 2024-09-21T07:01:20.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:20.997+0000 7fc37f95e640 1 -- 172.21.15.63:0/3387143380 wait complete. 2024-09-21T07:01:21.412 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:01:17.210494+0000', 'modified': '2024-09-21T07:01:19.847965+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5103': {'gid': 5103, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.63:6835/2711820189', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6833', 'nonce': 2711820189}, {'type': 'v1', 'addr': '172.21.15.63:6835', 'nonce': 2711820189}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-21T07:01:21.412 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5103:up:rejoin 2024-09-21T07:01:22.413 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:01:22.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.544+0000 7f44f23c3640 1 -- 172.21.15.63:0/3748011797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d4004130 msgr2=0x7f44d4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:22.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.544+0000 7f44f23c3640 1 --2- 172.21.15.63:0/3748011797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d4004130 0x7f44d4004800 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f44e0001690 tx=0x7f44d4005830 comp rx=0 tx=0).stop 2024-09-21T07:01:22.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.544+0000 7f44f0960640 1 -- 172.21.15.63:0/3748011797 reap_dead start 2024-09-21T07:01:22.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.544+0000 7f44f23c3640 1 -- 172.21.15.63:0/3748011797 shutdown_connections 2024-09-21T07:01:22.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.544+0000 7f44f23c3640 1 -- 172.21.15.63:0/3748011797 >> 172.21.15.63:0/3748011797 conn(0x7f44ec08bfd0 msgr2=0x7f44ec0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:22.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.544+0000 7f44f23c3640 1 -- 172.21.15.63:0/3748011797 shutdown_connections 2024-09-21T07:01:22.546 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.544+0000 7f44f23c3640 1 -- 172.21.15.63:0/3748011797 wait complete. 2024-09-21T07:01:22.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.546+0000 7f44f23c3640 1 Processor -- start 2024-09-21T07:01:22.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.546+0000 7f44f23c3640 1 -- start start 2024-09-21T07:01:22.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.547+0000 7f44f23c3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d4004130 0x7f44ec0cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:22.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.547+0000 7f44f23c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ec0b3ba0 0x7f44ec161da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.547+0000 7f44f23c3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f44ec1f9020 0x7f44ec1f9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.547+0000 7f44f23c3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f44ec0cfe30 con 0x7f44d4004130 2024-09-21T07:01:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.547+0000 7f44f23c3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f44ec0d2790 con 0x7f44ec0b3ba0 2024-09-21T07:01:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.547+0000 7f44f23c3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f44ec0cffb0 con 0x7f44ec1f9020 2024-09-21T07:01:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44ebfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d4004130 0x7f44ec0cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44ebfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d4004130 0x7f44ec0cdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38140/0 (socket says 172.21.15.63:38140) 2024-09-21T07:01:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44ebfff640 1 -- 172.21.15.63:0/897922825 learned_addr learned my addr 172.21.15.63:0/897922825 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44f0960640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f44ec1f9020 0x7f44ec1f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44eb7fe640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ec0b3ba0 0x7f44ec161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44ebfff640 1 -- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f44ec1f9020 msgr2=0x7f44ec1f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44ebfff640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f44ec1f9020 0x7f44ec1f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44ebfff640 1 -- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ec0b3ba0 msgr2=0x7f44ec161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44ebfff640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ec0b3ba0 0x7f44ec161da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:22.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44ebfff640 1 -- 172.21.15.63:0/897922825 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44ec1f9970 con 0x7f44d4004130 2024-09-21T07:01:22.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44ebfff640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d4004130 0x7f44ec0cdd90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f44dc011ae0 tx=0x7f44dc009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:22.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44e8ff9640 1 -- 172.21.15.63:0/897922825 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc01e070 con 0x7f44d4004130 2024-09-21T07:01:22.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44e8ff9640 1 -- 172.21.15.63:0/897922825 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f44dc00fcd0 con 0x7f44d4004130 2024-09-21T07:01:22.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44f23c3640 1 -- 172.21.15.63:0/897922825 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44ec1622e0 con 0x7f44d4004130 2024-09-21T07:01:22.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44e8ff9640 1 -- 172.21.15.63:0/897922825 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc019670 con 0x7f44d4004130 2024-09-21T07:01:22.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.548+0000 7f44f23c3640 1 -- 172.21.15.63:0/897922825 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44ec0cd2b0 con 0x7f44d4004130 2024-09-21T07:01:22.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.550+0000 7f44f23c3640 1 -- 172.21.15.63:0/897922825 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44ec0d0510 con 0x7f44d4004130 2024-09-21T07:01:22.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.550+0000 7f44e8ff9640 1 -- 172.21.15.63:0/897922825 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f44dc021070 con 0x7f44d4004130 2024-09-21T07:01:22.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.551+0000 7f44e8ff9640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f44d8078bc0 0x7f44d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:22.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.551+0000 7f44e8ff9640 1 -- 172.21.15.63:0/897922825 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f44dc09b5f0 con 0x7f44d4004130 2024-09-21T07:01:22.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.551+0000 7f44eb7fe640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f44d8078bc0 0x7f44d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:22.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.552+0000 7f44eb7fe640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f44d8078bc0 0x7f44d807b0d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f44e0032000 tx=0x7f44e0001190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:22.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.556+0000 7f44e8ff9640 1 -- 172.21.15.63:0/897922825 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f44ec1f9970 con 0x7f44d4004130 2024-09-21T07:01:22.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.780+0000 7f44f23c3640 1 -- 172.21.15.63:0/897922825 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44ec06a130 con 0x7f44d4004130 2024-09-21T07:01:22.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.781+0000 7f44e8ff9640 1 -- 172.21.15.63:0/897922825 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5220 (secure 0 0 0) 0x7f44dc063390 con 0x7f44d4004130 2024-09-21T07:01:22.783 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:22.783 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"btime":"2024-09-21T07:01:21:010053+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/585708774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":585708774},{"type":"v1","addr":"172.21.15.71:6836","nonce":585708774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4837,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2545148827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":2545148827},{"type":"v1","addr":"172.21.15.71:6837","nonce":2545148827}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/2618757202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2618757202},{"type":"v1","addr":"172.21.15.63:6834","nonce":2618757202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:01:17.210494+0000","modified":"2024-09-21T07:01:21.010048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6835/2711820189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2711820189},{"type":"v1","addr":"172.21.15.63:6835","nonce":2711820189}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":5103,"qdb_cluster":[5103]},"id":2}]} 2024-09-21T07:01:22.783 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 25 2024-09-21T07:01:22.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.783+0000 7f44f23c3640 1 -- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f44d8078bc0 msgr2=0x7f44d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:22.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.783+0000 7f44f23c3640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f44d8078bc0 0x7f44d807b0d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f44e0032000 tx=0x7f44e0001190 comp rx=0 tx=0).stop 2024-09-21T07:01:22.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.783+0000 7f44f23c3640 1 -- 172.21.15.63:0/897922825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d4004130 msgr2=0x7f44ec0cdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:22.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.783+0000 7f44f23c3640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d4004130 0x7f44ec0cdd90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f44dc011ae0 tx=0x7f44dc009ee0 comp rx=0 tx=0).stop 2024-09-21T07:01:22.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.783+0000 7f44f23c3640 1 -- 172.21.15.63:0/897922825 shutdown_connections 2024-09-21T07:01:22.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.783+0000 7f44f23c3640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f44d8078bc0 0x7f44d807b0d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:22.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.783+0000 7f44f23c3640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f44ec1f9020 0x7f44ec1f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:22.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.783+0000 7f44f23c3640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44ec0b3ba0 0x7f44ec161da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:22.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.783+0000 7f44f23c3640 1 --2- 172.21.15.63:0/897922825 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d4004130 0x7f44ec0cdd90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:22.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.783+0000 7f44f23c3640 1 -- 172.21.15.63:0/897922825 >> 172.21.15.63:0/897922825 conn(0x7f44ec08bfd0 msgr2=0x7f44ec0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:22.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.783+0000 7f44f23c3640 1 -- 172.21.15.63:0/897922825 shutdown_connections 2024-09-21T07:01:22.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:22.783+0000 7f44f23c3640 1 -- 172.21.15.63:0/897922825 wait complete. 2024-09-21T07:01:22.830 INFO:tasks.ceph.mds.a.smithi063.stderr:2024-09-21T07:01:22.829+0000 7feb5fd3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:01:23.241 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T07:01:17.210494+0000', 'modified': '2024-09-21T07:01:21.010048+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5103': {'gid': 5103, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.63:6835/2711820189', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6833', 'nonce': 2711820189}, {'type': 'v1', 'addr': '172.21.15.63:6835', 'nonce': 2711820189}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 5103, 'qdb_cluster': [5103]} 2024-09-21T07:01:23.241 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T07:01:23.241 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-21T07:01:23.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.360+0000 7fe15a24d640 1 -- 172.21.15.63:0/4149015656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1540b9aa0 msgr2=0x7fe1540d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.360+0000 7fe15a24d640 1 --2- 172.21.15.63:0/4149015656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1540b9aa0 0x7fe1540d0bf0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe148005fd0 tx=0x7fe14802a5f0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.360+0000 7fe15a24d640 1 -- 172.21.15.63:0/4149015656 shutdown_connections 2024-09-21T07:01:23.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.360+0000 7fe15a24d640 1 --2- 172.21.15.63:0/4149015656 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1540b9aa0 0x7fe1540d0bf0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.360+0000 7fe15a24d640 1 -- 172.21.15.63:0/4149015656 >> 172.21.15.63:0/4149015656 conn(0x7fe1540d45e0 msgr2=0x7fe1540d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:23.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.360+0000 7fe15a24d640 1 -- 172.21.15.63:0/4149015656 shutdown_connections 2024-09-21T07:01:23.363 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.360+0000 7fe15a24d640 1 -- 172.21.15.63:0/4149015656 wait complete. 2024-09-21T07:01:23.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.362+0000 7fe15a24d640 1 Processor -- start 2024-09-21T07:01:23.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.362+0000 7fe15a24d640 1 -- start start 2024-09-21T07:01:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe15a24d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe15408c960 0x7fe1541f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe15a24d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe1540b3aa0 0x7fe154155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe15a24d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1540b9aa0 0x7fe154160790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe15a24d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe15406f410 con 0x7fe15408c960 2024-09-21T07:01:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe15a24d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe15406f290 con 0x7fe1540b9aa0 2024-09-21T07:01:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe15a24d640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe1540d1130 con 0x7fe1540b3aa0 2024-09-21T07:01:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe15408c960 0x7fe1541f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe15408c960 0x7fe1541f58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38158/0 (socket says 172.21.15.63:38158) 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe1537fe640 1 -- 172.21.15.63:0/3622640886 learned_addr learned my addr 172.21.15.63:0/3622640886 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe152ffd640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe1540b3aa0 0x7fe154155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe153fff640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1540b9aa0 0x7fe154160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe1537fe640 1 -- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe1540b3aa0 msgr2=0x7fe154155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe1537fe640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe1540b3aa0 0x7fe154155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe1537fe640 1 -- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1540b9aa0 msgr2=0x7fe154160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe1537fe640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1540b9aa0 0x7fe154160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe1537fe640 1 -- 172.21.15.63:0/3622640886 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1540ce250 con 0x7fe15408c960 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.364+0000 7fe1537fe640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe15408c960 0x7fe1541f58e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c430 tx=0x7fe14400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.365+0000 7fe13bfff640 1 -- 172.21.15.63:0/3622640886 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144017070 con 0x7fe15408c960 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.365+0000 7fe13bfff640 1 -- 172.21.15.63:0/3622640886 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1440053c0 con 0x7fe15408c960 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.365+0000 7fe13bfff640 1 -- 172.21.15.63:0/3622640886 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1440038a0 con 0x7fe15408c960 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.365+0000 7fe15a24d640 1 -- 172.21.15.63:0/3622640886 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1540ce530 con 0x7fe15408c960 2024-09-21T07:01:23.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.365+0000 7fe15a24d640 1 -- 172.21.15.63:0/3622640886 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1541f5eb0 con 0x7fe15408c960 2024-09-21T07:01:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.367+0000 7fe13bfff640 1 -- 172.21.15.63:0/3622640886 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe14401a070 con 0x7fe15408c960 2024-09-21T07:01:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.367+0000 7fe13bfff640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe140078b90 0x7fe14007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.367+0000 7fe13bfff640 1 -- 172.21.15.63:0/3622640886 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fe14409a020 con 0x7fe15408c960 2024-09-21T07:01:23.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.368+0000 7fe152ffd640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe140078b90 0x7fe14007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.368+0000 7fe1611bd740 1 Processor -- start 2024-09-21T07:01:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.368+0000 7fe152ffd640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe140078b90 0x7fe14007b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe148033000 tx=0x7fe148004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:23.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.368+0000 7fe1611bd740 1 -- start start 2024-09-21T07:01:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe1611bd740 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073823270 0x55a073bf4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe1611bd740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073bf54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe1611bd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073802590 0x55a073c123e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe1611bd740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a073b3d820 con 0x55a0737fa3b0 2024-09-21T07:01:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe1611bd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a073b2cc50 con 0x55a073802590 2024-09-21T07:01:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe1611bd740 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x55a073b30a60 con 0x55a073823270 2024-09-21T07:01:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe152ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073bf54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe152ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073bf54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38172/0 (socket says 172.21.15.63:38172) 2024-09-21T07:01:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe152ffd640 1 -- 172.21.15.63:0/544475846 learned_addr learned my addr 172.21.15.63:0/544475846 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe152ffd640 1 -- 172.21.15.63:0/544475846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073823270 msgr2=0x55a073bf4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe1537fe640 1 --2- 172.21.15.63:0/544475846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073823270 0x55a073bf4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe152ffd640 1 --2- 172.21.15.63:0/544475846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073823270 0x55a073bf4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe152ffd640 1 -- 172.21.15.63:0/544475846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073802590 msgr2=0x55a073c123e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:23.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe153fff640 1 --2- 172.21.15.63:0/544475846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073802590 0x55a073c123e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe152ffd640 1 --2- 172.21.15.63:0/544475846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073802590 0x55a073c123e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe152ffd640 1 -- 172.21.15.63:0/544475846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a07388e850 con 0x55a0737fa3b0 2024-09-21T07:01:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe153fff640 1 --2- 172.21.15.63:0/544475846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073802590 0x55a073c123e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:01:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe152ffd640 1 --2- 172.21.15.63:0/544475846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073bf54e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe1480096c0 tx=0x7fe14803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c88963b2496333 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.370+0000 7fe139ffb640 1 -- 172.21.15.63:0/544475846 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148035040 con 0x55a0737fa3b0 2024-09-21T07:01:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.371+0000 7fe139ffb640 1 -- 172.21.15.63:0/544475846 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe14804d070 con 0x55a0737fa3b0 2024-09-21T07:01:23.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.371+0000 7fe139ffb640 1 -- 172.21.15.63:0/544475846 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148003da0 con 0x55a0737fa3b0 2024-09-21T07:01:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.371+0000 7fe1611bd740 1 -- 172.21.15.63:0/544475846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 msgr2=0x55a073bf54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.371+0000 7fe1611bd740 1 --2- 172.21.15.63:0/544475846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073bf54e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe1480096c0 tx=0x7fe14803d000 comp rx=0 tx=0).stop 2024-09-21T07:01:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.371+0000 7fe1611bd740 1 -- 172.21.15.63:0/544475846 shutdown_connections 2024-09-21T07:01:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.371+0000 7fe1611bd740 1 --2- 172.21.15.63:0/544475846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073802590 0x55a073c123e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.371+0000 7fe1611bd740 1 --2- 172.21.15.63:0/544475846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073bf54e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.371+0000 7fe1611bd740 1 --2- 172.21.15.63:0/544475846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073823270 0x55a073bf4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.371+0000 7fe1611bd740 1 -- 172.21.15.63:0/544475846 >> 172.21.15.63:0/544475846 conn(0x55a0738173c0 msgr2=0x55a073bcb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.371+0000 7fe1611bd740 1 -- 172.21.15.63:0/544475846 shutdown_connections 2024-09-21T07:01:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.371+0000 7fe1611bd740 1 -- 172.21.15.63:0/544475846 wait complete. 2024-09-21T07:01:23.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.372+0000 7fe1611bd740 1 -- start start 2024-09-21T07:01:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.372+0000 7fe1611bd740 1 Processor -- start 2024-09-21T07:01:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe1611bd740 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a0737fa3b0 0x55a073c096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe1611bd740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a073802590 0x55a073be3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe1611bd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073823270 0x55a073c12140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe1611bd740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a07389d620 con 0x55a073802590 2024-09-21T07:01:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe1611bd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a073ad25f0 con 0x55a073823270 2024-09-21T07:01:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe1611bd740 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x55a073bf5a20 con 0x55a0737fa3b0 2024-09-21T07:01:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe1611bd740 10 client.0 _ll_register_callbacks cb 0x55a073ad60a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:01:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe152ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a073802590 0x55a073be3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe152ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a073802590 0x55a073be3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38184/0 (socket says 172.21.15.63:38184) 2024-09-21T07:01:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe152ffd640 1 -- 172.21.15.63:0/1389931952 learned_addr learned my addr 172.21.15.63:0/1389931952 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe1537fe640 1 --2- 172.21.15.63:0/1389931952 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a0737fa3b0 0x55a073c096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe153fff640 1 --2- 172.21.15.63:0/1389931952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073823270 0x55a073c12140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe152ffd640 1 -- 172.21.15.63:0/1389931952 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a0737fa3b0 msgr2=0x55a073c096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe152ffd640 1 --2- 172.21.15.63:0/1389931952 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a0737fa3b0 0x55a073c096e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe152ffd640 1 -- 172.21.15.63:0/1389931952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073823270 msgr2=0x55a073c12140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe152ffd640 1 --2- 172.21.15.63:0/1389931952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073823270 0x55a073c12140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe152ffd640 1 -- 172.21.15.63:0/1389931952 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0739056b0 con 0x55a073802590 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe152ffd640 1 --2- 172.21.15.63:0/1389931952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a073802590 0x55a073be3650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe1480099f0 tx=0x7fe148003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16f1680e2a3eb9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe1327fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.374+0000 7fe1327fc640 1 -- 172.21.15.63:0/1389931952 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148004bb0 con 0x55a073802590 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1327fc640 1 -- 172.21.15.63:0/1389931952 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fe148004d50 con 0x55a073802590 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1611bd740 1 -- 172.21.15.63:0/1389931952 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe14804d070 con 0x55a073802590 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1327fc640 1 -- 172.21.15.63:0/1389931952 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe148004f50 con 0x55a073802590 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1611bd740 10 client.5160 fetch_fsmap learned FSMap version 25 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1611bd740 1 -- 172.21.15.63:0/1389931952 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55a073c0a010 con 0x55a073802590 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1327fc640 1 -- 172.21.15.63:0/1389931952 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe14804d070 con 0x55a073802590 2024-09-21T07:01:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1327fc640 1 -- 172.21.15.63:0/1389931952 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fe148048470 con 0x55a073802590 2024-09-21T07:01:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1611bd740 10 client.5160 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T07:01:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1611bd740 10 client.5160 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:01:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1611bd740 20 client.5160 populate_metadata read hostname 'smithi063' 2024-09-21T07:01:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1611bd740 1 --2- 172.21.15.63:0/1389931952 >> [v2:172.21.15.63:6833/2711820189,v1:172.21.15.63:6835/2711820189] conn(0x55a0737e1e40 0x55a073bed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1611bd740 4 client.5160 mds_command: new command op to 5103 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T07:01:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1611bd740 1 -- 172.21.15.63:0/1389931952 --> [v2:172.21.15.63:6833/2711820189,v1:172.21.15.63:6835/2711820189] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a073b3f770 con 0x55a0737e1e40 2024-09-21T07:01:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.375+0000 7fe1537fe640 1 --2- 172.21.15.63:0/1389931952 >> [v2:172.21.15.63:6833/2711820189,v1:172.21.15.63:6835/2711820189] conn(0x55a0737e1e40 0x55a073bed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.376+0000 7fe1327fc640 10 client.5160 ms_handle_connect on v2:172.21.15.63:6833/2711820189 2024-09-21T07:01:23.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.376+0000 7fe1537fe640 1 --2- 172.21.15.63:0/1389931952 >> [v2:172.21.15.63:6833/2711820189,v1:172.21.15.63:6835/2711820189] conn(0x55a0737e1e40 0x55a073bed2d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e95fdfb9853bfdf server_cookie=d603d01d509cad0b in_seq=0 out_seq=0 2024-09-21T07:01:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.376+0000 7fe1327fc640 1 -- 172.21.15.63:0/1389931952 <== mds.0 v2:172.21.15.63:6833/2711820189 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a073b3f770 con 0x55a0737e1e40 2024-09-21T07:01:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.376+0000 7fe1327fc640 10 client.5160 handle_command_reply: tid=0 2024-09-21T07:01:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.376+0000 7fe1611bd740 1 client.5160 shutdown 2024-09-21T07:01:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.376+0000 7fe1611bd740 1 -- 172.21.15.63:0/1389931952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a073802590 msgr2=0x55a073be3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.377+0000 7fe1611bd740 1 --2- 172.21.15.63:0/1389931952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a073802590 0x55a073be3650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe1480099f0 tx=0x7fe148003f90 comp rx=0 tx=0).stop 2024-09-21T07:01:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.377+0000 7fe1611bd740 1 -- 172.21.15.63:0/1389931952 shutdown_connections 2024-09-21T07:01:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.377+0000 7fe1611bd740 1 --2- 172.21.15.63:0/1389931952 >> [v2:172.21.15.63:6833/2711820189,v1:172.21.15.63:6835/2711820189] conn(0x55a0737e1e40 0x55a073bed2d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.377+0000 7fe1611bd740 1 --2- 172.21.15.63:0/1389931952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073823270 0x55a073c12140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.377+0000 7fe1611bd740 1 --2- 172.21.15.63:0/1389931952 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a073802590 0x55a073be3650 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.377+0000 7fe1611bd740 1 --2- 172.21.15.63:0/1389931952 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a0737fa3b0 0x55a073c096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.377+0000 7fe1327fc640 0 client.5160 ms_handle_reset on v2:172.21.15.63:6833/2711820189 2024-09-21T07:01:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.377+0000 7fe1611bd740 1 -- 172.21.15.63:0/1389931952 >> 172.21.15.63:0/1389931952 conn(0x55a0738173c0 msgr2=0x55a073bc4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.377+0000 7fe1611bd740 1 -- 172.21.15.63:0/1389931952 shutdown_connections 2024-09-21T07:01:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.377+0000 7fe1611bd740 1 -- 172.21.15.63:0/1389931952 wait complete. 2024-09-21T07:01:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.377+0000 7fe1611bd740 20 client.5160 trim_cache size 0 max 16384 2024-09-21T07:01:23.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.395+0000 7fe1611bd740 1 Processor -- start 2024-09-21T07:01:23.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.395+0000 7fe1611bd740 1 -- start start 2024-09-21T07:01:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1611bd740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073bf4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1611bd740 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073802590 0x55a073bf5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1611bd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073823270 0x55a073c32940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1611bd740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe1542010e0 con 0x55a0737fa3b0 2024-09-21T07:01:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1611bd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe15415f640 con 0x55a073823270 2024-09-21T07:01:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1611bd740 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe15415fc90 con 0x55a073802590 2024-09-21T07:01:23.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073bf4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073bf4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38196/0 (socket says 172.21.15.63:38196) 2024-09-21T07:01:23.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1537fe640 1 -- 172.21.15.63:0/1378909673 learned_addr learned my addr 172.21.15.63:0/1378909673 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:23.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1537fe640 1 -- 172.21.15.63:0/1378909673 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073802590 msgr2=0x55a073bf5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:23.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1537fe640 1 --2- 172.21.15.63:0/1378909673 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073802590 0x55a073bf5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1537fe640 1 -- 172.21.15.63:0/1378909673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073823270 msgr2=0x55a073c32940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:23.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1537fe640 1 --2- 172.21.15.63:0/1378909673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073823270 0x55a073c32940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1537fe640 1 -- 172.21.15.63:0/1378909673 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a073c124b0 con 0x55a0737fa3b0 2024-09-21T07:01:23.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1537fe640 1 --2- 172.21.15.63:0/1378909673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073bf4d00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe144005670 tx=0x7fe14405e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3814e520e74adb5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:23.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1397fa640 1 -- 172.21.15.63:0/1378909673 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144066850 con 0x55a0737fa3b0 2024-09-21T07:01:23.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1397fa640 1 -- 172.21.15.63:0/1378909673 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe14406b700 con 0x55a0737fa3b0 2024-09-21T07:01:23.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.397+0000 7fe1397fa640 1 -- 172.21.15.63:0/1378909673 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144069b40 con 0x55a0737fa3b0 2024-09-21T07:01:23.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.398+0000 7fe1611bd740 1 -- 172.21.15.63:0/1378909673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 msgr2=0x55a073bf4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.398+0000 7fe1611bd740 1 --2- 172.21.15.63:0/1378909673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073bf4d00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe144005670 tx=0x7fe14405e5a0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.398+0000 7fe1611bd740 1 -- 172.21.15.63:0/1378909673 shutdown_connections 2024-09-21T07:01:23.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.398+0000 7fe1611bd740 1 --2- 172.21.15.63:0/1378909673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073823270 0x55a073c32940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.398+0000 7fe1611bd740 1 --2- 172.21.15.63:0/1378909673 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073802590 0x55a073bf5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.398+0000 7fe1611bd740 1 --2- 172.21.15.63:0/1378909673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073bf4d00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.398+0000 7fe1611bd740 1 -- 172.21.15.63:0/1378909673 >> 172.21.15.63:0/1378909673 conn(0x55a0738173c0 msgr2=0x55a073bcb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:23.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.398+0000 7fe1611bd740 1 -- 172.21.15.63:0/1378909673 shutdown_connections 2024-09-21T07:01:23.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.398+0000 7fe1611bd740 1 -- 172.21.15.63:0/1378909673 wait complete. 2024-09-21T07:01:23.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.399+0000 7fe1611bd740 1 -- start start 2024-09-21T07:01:23.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.399+0000 7fe1611bd740 1 Processor -- start 2024-09-21T07:01:23.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.400+0000 7fe1611bd740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073c8e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.400+0000 7fe1611bd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073802590 0x55a073c32ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.400+0000 7fe1611bd740 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073823270 0x55a073c33220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.400+0000 7fe1611bd740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a073c1fd20 con 0x55a0737fa3b0 2024-09-21T07:01:23.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.400+0000 7fe1611bd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a07389d620 con 0x55a073802590 2024-09-21T07:01:23.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.400+0000 7fe1611bd740 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x55a073c23300 con 0x55a073823270 2024-09-21T07:01:23.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.400+0000 7fe1611bd740 10 client.0 _ll_register_callbacks cb 0x7fe148004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T07:01:23.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.400+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073c8e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.400+0000 7fe1537fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073c8e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38210/0 (socket says 172.21.15.63:38210) 2024-09-21T07:01:23.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.400+0000 7fe1537fe640 1 -- 172.21.15.63:0/2505122141 learned_addr learned my addr 172.21.15.63:0/2505122141 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:23.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe153fff640 1 --2- 172.21.15.63:0/2505122141 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073823270 0x55a073c33220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe152ffd640 1 --2- 172.21.15.63:0/2505122141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073802590 0x55a073c32ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1537fe640 1 -- 172.21.15.63:0/2505122141 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073823270 msgr2=0x55a073c33220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:23.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1537fe640 1 --2- 172.21.15.63:0/2505122141 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073823270 0x55a073c33220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1537fe640 1 -- 172.21.15.63:0/2505122141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073802590 msgr2=0x55a073c32ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T07:01:23.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1537fe640 1 --2- 172.21.15.63:0/2505122141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073802590 0x55a073c32ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1537fe640 1 -- 172.21.15.63:0/2505122141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a073c09390 con 0x55a0737fa3b0 2024-09-21T07:01:23.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1537fe640 1 --2- 172.21.15.63:0/2505122141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073c8e620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe144001190 tx=0x7fe14405e4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96beb7202ad8f711 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1327fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1327fc640 1 -- 172.21.15.63:0/2505122141 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144069d40 con 0x55a0737fa3b0 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1327fc640 1 -- 172.21.15.63:0/2505122141 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fe144061080 con 0x55a0737fa3b0 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1611bd740 1 -- 172.21.15.63:0/2505122141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe14406b700 con 0x55a0737fa3b0 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1327fc640 1 -- 172.21.15.63:0/2505122141 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe144061280 con 0x55a0737fa3b0 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1611bd740 10 client.5166 fetch_fsmap learned FSMap version 25 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1611bd740 1 -- 172.21.15.63:0/2505122141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55a073c12bc0 con 0x55a0737fa3b0 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1327fc640 1 -- 172.21.15.63:0/2505122141 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe14406b700 con 0x55a0737fa3b0 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.401+0000 7fe1327fc640 1 -- 172.21.15.63:0/2505122141 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 25) ==== 3502+0+0 (secure 0 0 0) 0x7fe14405d770 con 0x55a0737fa3b0 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 10 client.5166 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 10 client.5166 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 20 client.5166 populate_metadata read hostname 'smithi063' 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 1 --2- 172.21.15.63:0/2505122141 >> [v2:172.21.15.63:6833/2711820189,v1:172.21.15.63:6835/2711820189] conn(0x55a073c321e0 0x55a073c9a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 4 client.5166 mds_command: new command op to 5103 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T07:01:23.407 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 1 -- 172.21.15.63:0/2505122141 --> [v2:172.21.15.63:6833/2711820189,v1:172.21.15.63:6835/2711820189] -- command(tid 0: {"prefix": "status"}) -- 0x55a073bf0900 con 0x55a073c321e0 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe152ffd640 1 --2- 172.21.15.63:0/2505122141 >> [v2:172.21.15.63:6833/2711820189,v1:172.21.15.63:6835/2711820189] conn(0x55a073c321e0 0x55a073c9a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1327fc640 10 client.5166 ms_handle_connect on v2:172.21.15.63:6833/2711820189 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe152ffd640 1 --2- 172.21.15.63:0/2505122141 >> [v2:172.21.15.63:6833/2711820189,v1:172.21.15.63:6835/2711820189] conn(0x55a073c321e0 0x55a073c9a1c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a255f8196ad135ee server_cookie=537211ca7e15203a in_seq=0 out_seq=0 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1327fc640 1 -- 172.21.15.63:0/2505122141 <== mds.0 v2:172.21.15.63:6833/2711820189 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a073bf0900 con 0x55a073c321e0 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1327fc640 10 client.5166 handle_command_reply: tid=0 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 1 client.5166 shutdown 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 1 -- 172.21.15.63:0/2505122141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 msgr2=0x55a073c8e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 1 --2- 172.21.15.63:0/2505122141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073c8e620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe144001190 tx=0x7fe14405e4e0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 1 -- 172.21.15.63:0/2505122141 shutdown_connections 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 1 --2- 172.21.15.63:0/2505122141 >> [v2:172.21.15.63:6833/2711820189,v1:172.21.15.63:6835/2711820189] conn(0x55a073c321e0 0x55a073c9a1c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 1 --2- 172.21.15.63:0/2505122141 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x55a073823270 0x55a073c33220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 1 --2- 172.21.15.63:0/2505122141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a073802590 0x55a073c32ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1327fc640 0 client.5166 ms_handle_reset on v2:172.21.15.63:6833/2711820189 2024-09-21T07:01:23.408 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 1 --2- 172.21.15.63:0/2505122141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a0737fa3b0 0x55a073c8e620 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.402+0000 7fe1611bd740 1 -- 172.21.15.63:0/2505122141 >> 172.21.15.63:0/2505122141 conn(0x55a0738173c0 msgr2=0x55a073bcb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:23.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe1611bd740 1 -- 172.21.15.63:0/2505122141 shutdown_connections 2024-09-21T07:01:23.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe1611bd740 1 -- 172.21.15.63:0/2505122141 wait complete. 2024-09-21T07:01:23.409 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe1611bd740 20 client.5166 trim_cache size 0 max 16384 2024-09-21T07:01:23.409 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T07:01:23.409 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "2c317557-147d-48e9-8f3c-bb88131d3e37", 2024-09-21T07:01:23.409 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-09-21T07:01:23.409 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 5103, 2024-09-21T07:01:23.409 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-09-21T07:01:23.409 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-09-21T07:01:23.410 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-09-21T07:01:23.410 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 4.5602213730000001, 2024-09-21T07:01:23.410 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 25, 2024-09-21T07:01:23.410 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 35, 2024-09-21T07:01:23.410 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 35, 2024-09-21T07:01:23.410 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 7.5505628409999996 2024-09-21T07:01:23.410 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T07:01:23.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe15a24d640 1 -- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe140078b90 msgr2=0x7fe14007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe15a24d640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe140078b90 0x7fe14007b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe148033000 tx=0x7fe148004730 comp rx=0 tx=0).stop 2024-09-21T07:01:23.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe15a24d640 1 -- 172.21.15.63:0/3622640886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe15408c960 msgr2=0x7fe1541f58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe15a24d640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe15408c960 0x7fe1541f58e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c430 tx=0x7fe14400c8f0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe15a24d640 1 -- 172.21.15.63:0/3622640886 shutdown_connections 2024-09-21T07:01:23.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe15a24d640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe140078b90 0x7fe14007b0a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe15a24d640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1540b9aa0 0x7fe154160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe15a24d640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe1540b3aa0 0x7fe154155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe15a24d640 1 --2- 172.21.15.63:0/3622640886 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe15408c960 0x7fe1541f58e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe15a24d640 1 -- 172.21.15.63:0/3622640886 >> 172.21.15.63:0/3622640886 conn(0x7fe1540d45e0 msgr2=0x7fe15406f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:23.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe15a24d640 1 -- 172.21.15.63:0/3622640886 shutdown_connections 2024-09-21T07:01:23.412 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.403+0000 7fe15a24d640 1 -- 172.21.15.63:0/3622640886 wait complete. 2024-09-21T07:01:23.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:23.416 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/file_on_fs_0) 2024-09-21T07:01:23.435 INFO:teuthology.orchestra.run.smithi063.stdout:0 2024-09-21T07:01:23.435 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-21T07:01:23.435 DEBUG:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:01:23.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-21T07:01:23.569 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-21T07:01:23.569 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:01:23.570 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:01:23.570 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:01:23.586 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:01:23.586 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:01:23.642 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-21T07:01:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.797+0000 7f5e34a0e640 1 -- 172.21.15.63:0/1209437239 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e300b3aa0 msgr2=0x7f5e300d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.797+0000 7f5e34a0e640 1 --2- 172.21.15.63:0/1209437239 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e300b3aa0 0x7f5e300d2fd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5e300b3eb0 tx=0x7f5e2802a560 comp rx=0 tx=0).stop 2024-09-21T07:01:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.797+0000 7f5e34a0e640 1 -- 172.21.15.63:0/1209437239 shutdown_connections 2024-09-21T07:01:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.797+0000 7f5e34a0e640 1 --2- 172.21.15.63:0/1209437239 >> v2:172.21.15.71:3300/0 conn(0x7f5e300b9aa0 0x7f5e300d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.797+0000 7f5e34a0e640 1 --2- 172.21.15.63:0/1209437239 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e300b3aa0 0x7f5e300d2fd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.797+0000 7f5e34a0e640 1 -- 172.21.15.63:0/1209437239 >> 172.21.15.63:0/1209437239 conn(0x7f5e300d45e0 msgr2=0x7f5e300d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.797+0000 7f5e34a0e640 1 -- 172.21.15.63:0/1209437239 shutdown_connections 2024-09-21T07:01:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.797+0000 7f5e34a0e640 1 -- 172.21.15.63:0/1209437239 wait complete. 2024-09-21T07:01:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.799+0000 7f5e34a0e640 1 Processor -- start 2024-09-21T07:01:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.799+0000 7f5e34a0e640 1 -- start start 2024-09-21T07:01:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e34a0e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e3008c960 0x7f5e301f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e34a0e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e300b3aa0 0x7f5e3015d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e34a0e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e300b9aa0 0x7f5e300c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e34a0e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3006f1c0 con 0x7f5e300b3aa0 2024-09-21T07:01:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e34a0e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3006f040 con 0x7f5e300b9aa0 2024-09-21T07:01:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e34a0e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5e3006f340 con 0x7f5e3008c960 2024-09-21T07:01:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e2dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e300b3aa0 0x7f5e3015d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e2dd9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e300b3aa0 0x7f5e3015d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38230/0 (socket says 172.21.15.63:38230) 2024-09-21T07:01:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e2dd9b640 1 -- 172.21.15.63:0/4018456863 learned_addr learned my addr 172.21.15.63:0/4018456863 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e2e59c640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e3008c960 0x7f5e301f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e2ed9d640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e300b9aa0 0x7f5e300c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e2dd9b640 1 -- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e3008c960 msgr2=0x7f5e301f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e2dd9b640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e3008c960 0x7f5e301f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e2dd9b640 1 -- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e300b9aa0 msgr2=0x7f5e300c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e2dd9b640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e300b9aa0 0x7f5e300c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e2dd9b640 1 -- 172.21.15.63:0/4018456863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e300ce420 con 0x7f5e300b3aa0 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e2e59c640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e3008c960 0x7f5e301f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e2ed9d640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e300b9aa0 0x7f5e300c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.801+0000 7f5e2dd9b640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e300b3aa0 0x7f5e3015d400 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800d740 tx=0x7f5e1800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.802+0000 7f5e26ffd640 1 -- 172.21.15.63:0/4018456863 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18017070 con 0x7f5e300b3aa0 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.802+0000 7f5e26ffd640 1 -- 172.21.15.63:0/4018456863 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e18009d20 con 0x7f5e300b3aa0 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.802+0000 7f5e34a0e640 1 -- 172.21.15.63:0/4018456863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e300ce700 con 0x7f5e300b3aa0 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.802+0000 7f5e26ffd640 1 -- 172.21.15.63:0/4018456863 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180106c0 con 0x7f5e300b3aa0 2024-09-21T07:01:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.802+0000 7f5e34a0e640 1 -- 172.21.15.63:0/4018456863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e301f5ac0 con 0x7f5e300b3aa0 2024-09-21T07:01:23.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.803+0000 7f5e34a0e640 1 -- 172.21.15.63:0/4018456863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e300d1340 con 0x7f5e300b3aa0 2024-09-21T07:01:23.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.803+0000 7f5e26ffd640 1 -- 172.21.15.63:0/4018456863 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5e1801a070 con 0x7f5e300b3aa0 2024-09-21T07:01:23.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.804+0000 7f5e26ffd640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5e10078b90 0x7f5e1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:23.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.804+0000 7f5e26ffd640 1 -- 172.21.15.63:0/4018456863 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f5e1809af60 con 0x7f5e300b3aa0 2024-09-21T07:01:23.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.804+0000 7f5e2e59c640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5e10078b90 0x7f5e1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:23.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.805+0000 7f5e2e59c640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5e10078b90 0x7f5e1007b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e28034000 tx=0x7f5e28004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:23.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:23.808+0000 7f5e26ffd640 1 -- 172.21.15.63:0/4018456863 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5e18063340 con 0x7f5e300b3aa0 2024-09-21T07:01:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.009+0000 7f5e34a0e640 1 -- 172.21.15.63:0/4018456863 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5e3006fb20 con 0x7f5e300b3aa0 2024-09-21T07:01:24.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.009+0000 7f5e26ffd640 1 -- 172.21.15.63:0/4018456863 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v35) ==== 80+0+122 (secure 0 0 0) 0x7f5e18062c40 con 0x7f5e300b3aa0 2024-09-21T07:01:24.011 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6835/3748950985 2024-09-22T07:01:15.789578+0000 2024-09-21T07:01:24.011 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63:6833/3748950985 2024-09-22T07:01:15.789578+0000 2024-09-21T07:01:24.012 INFO:teuthology.orchestra.run.smithi063.stderr:listed 2 entries 2024-09-21T07:01:24.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.011+0000 7f5e34a0e640 1 -- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5e10078b90 msgr2=0x7f5e1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.011+0000 7f5e34a0e640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5e10078b90 0x7f5e1007b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e28034000 tx=0x7f5e28004730 comp rx=0 tx=0).stop 2024-09-21T07:01:24.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.011+0000 7f5e34a0e640 1 -- 172.21.15.63:0/4018456863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e300b3aa0 msgr2=0x7f5e3015d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.011+0000 7f5e34a0e640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e300b3aa0 0x7f5e3015d400 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800d740 tx=0x7f5e1800dc00 comp rx=0 tx=0).stop 2024-09-21T07:01:24.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.011+0000 7f5e34a0e640 1 -- 172.21.15.63:0/4018456863 shutdown_connections 2024-09-21T07:01:24.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.011+0000 7f5e34a0e640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5e10078b90 0x7f5e1007b0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.011+0000 7f5e34a0e640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e300b9aa0 0x7f5e300c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.011+0000 7f5e34a0e640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e300b3aa0 0x7f5e3015d400 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.011+0000 7f5e34a0e640 1 --2- 172.21.15.63:0/4018456863 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5e3008c960 0x7f5e301f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.011+0000 7f5e34a0e640 1 -- 172.21.15.63:0/4018456863 >> 172.21.15.63:0/4018456863 conn(0x7f5e300d45e0 msgr2=0x7f5e3015eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:24.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.012+0000 7f5e34a0e640 1 -- 172.21.15.63:0/4018456863 shutdown_connections 2024-09-21T07:01:24.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.012+0000 7f5e34a0e640 1 -- 172.21.15.63:0/4018456863 wait complete. 2024-09-21T07:01:24.024 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T07:01:24.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:24.025 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T07:01:24.054 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T07:01:24.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:24.054 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T07:01:24.110 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:01:24.111 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T07:01:24.111 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:01:24.130 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1566 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:01:24.130 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:01:24.130 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:01:24.130 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:01:24.166 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17502 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:01:24.166 INFO:tasks.cephfs.mount:Terminating background process 2024-09-21T07:01:24.166 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T07:01:24.167 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:01:24.188 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1566 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:01:24.189 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:01:24.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.320+0000 7fe603119640 1 -- 172.21.15.63:0/834029094 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc0b6ca0 msgr2=0x7fe5fc0b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.320+0000 7fe603119640 1 --2- 172.21.15.63:0/834029094 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc0b6ca0 0x7fe5fc0b6730 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0d01d0 tx=0x7fe5f802a560 comp rx=0 tx=0).stop 2024-09-21T07:01:24.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.320+0000 7fe603119640 1 -- 172.21.15.63:0/834029094 shutdown_connections 2024-09-21T07:01:24.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.320+0000 7fe603119640 1 --2- 172.21.15.63:0/834029094 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe5fc0d0920 0x7fe5fc06cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.320+0000 7fe603119640 1 --2- 172.21.15.63:0/834029094 >> v2:172.21.15.71:3300/0 conn(0x7fe5fc15c9a0 0x7fe5fc0d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.320+0000 7fe603119640 1 --2- 172.21.15.63:0/834029094 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc0b6ca0 0x7fe5fc0b6730 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.320+0000 7fe603119640 1 -- 172.21.15.63:0/834029094 >> 172.21.15.63:0/834029094 conn(0x7fe5fc0b2f70 msgr2=0x7fe5fc0b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:24.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.320+0000 7fe603119640 1 -- 172.21.15.63:0/834029094 shutdown_connections 2024-09-21T07:01:24.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.320+0000 7fe603119640 1 -- 172.21.15.63:0/834029094 wait complete. 2024-09-21T07:01:24.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.322+0000 7fe603119640 1 Processor -- start 2024-09-21T07:01:24.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.322+0000 7fe603119640 1 -- start start 2024-09-21T07:01:24.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.323+0000 7fe603119640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe5fc0b6ca0 0x7fe5fc0b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.323+0000 7fe603119640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc0d0920 0x7fe5fc14f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.323+0000 7fe603119640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc15c9a0 0x7fe5fc14fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.323+0000 7fe603119640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc06d470 con 0x7fe5fc0d0920 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.323+0000 7fe603119640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe5fc06d2f0 con 0x7fe5fc15c9a0 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.323+0000 7fe603119640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fe5fc06d5f0 con 0x7fe5fc0b6ca0 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe5f3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc0d0920 0x7fe5fc14f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe5f3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc0d0920 0x7fe5fc14f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38252/0 (socket says 172.21.15.63:38252) 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe5f3fff640 1 -- 172.21.15.63:0/1628371835 learned_addr learned my addr 172.21.15.63:0/1628371835 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe6016b6640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc15c9a0 0x7fe5fc14fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe600eb5640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe5fc0b6ca0 0x7fe5fc0b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe5f3fff640 1 -- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe5fc0b6ca0 msgr2=0x7fe5fc0b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe5f3fff640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe5fc0b6ca0 0x7fe5fc0b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe5f3fff640 1 -- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc15c9a0 msgr2=0x7fe5fc14fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe5f3fff640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc15c9a0 0x7fe5fc14fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe5f3fff640 1 -- 172.21.15.63:0/1628371835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5fc0cb970 con 0x7fe5fc0d0920 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe5f3fff640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc0d0920 0x7fe5fc14f810 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00d740 tx=0x7fe5ec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:24.327 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe5f17fa640 1 -- 172.21.15.63:0/1628371835 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec017070 con 0x7fe5fc0d0920 2024-09-21T07:01:24.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe5f17fa640 1 -- 172.21.15.63:0/1628371835 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5ec009d20 con 0x7fe5fc0d0920 2024-09-21T07:01:24.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe603119640 1 -- 172.21.15.63:0/1628371835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5fc15d200 con 0x7fe5fc0d0920 2024-09-21T07:01:24.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe5f17fa640 1 -- 172.21.15.63:0/1628371835 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0106c0 con 0x7fe5fc0d0920 2024-09-21T07:01:24.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.324+0000 7fe603119640 1 -- 172.21.15.63:0/1628371835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5fc0ce9a0 con 0x7fe5fc0d0920 2024-09-21T07:01:24.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.325+0000 7fe603119640 1 -- 172.21.15.63:0/1628371835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5fc06db80 con 0x7fe5fc0d0920 2024-09-21T07:01:24.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.326+0000 7fe5f17fa640 1 -- 172.21.15.63:0/1628371835 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe5ec01a070 con 0x7fe5fc0d0920 2024-09-21T07:01:24.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.326+0000 7fe5f17fa640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe5e8078b90 0x7fe5e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.327+0000 7fe5f17fa640 1 -- 172.21.15.63:0/1628371835 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fe5ec09af90 con 0x7fe5fc0d0920 2024-09-21T07:01:24.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.327+0000 7fe600eb5640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe5e8078b90 0x7fe5e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.327+0000 7fe600eb5640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe5e8078b90 0x7fe5e807b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8033000 tx=0x7fe5f8004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:24.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.331+0000 7fe5f17fa640 1 -- 172.21.15.63:0/1628371835 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fe5ec062ca0 con 0x7fe5fc0d0920 2024-09-21T07:01:24.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.554+0000 7fe603119640 1 -- 172.21.15.63:0/1628371835 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5fc0b35d0 con 0x7fe5fc0d0920 2024-09-21T07:01:24.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.555+0000 7fe5f17fa640 1 -- 172.21.15.63:0/1628371835 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5220 (secure 0 0 0) 0x7fe5ec0676d0 con 0x7fe5fc0d0920 2024-09-21T07:01:24.557 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:24.557 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"btime":"2024-09-21T07:01:21:010053+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/585708774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":585708774},{"type":"v1","addr":"172.21.15.71:6836","nonce":585708774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4837,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2545148827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":2545148827},{"type":"v1","addr":"172.21.15.71:6837","nonce":2545148827}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/2618757202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2618757202},{"type":"v1","addr":"172.21.15.63:6834","nonce":2618757202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:01:17.210494+0000","modified":"2024-09-21T07:01:21.010048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6835/2711820189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2711820189},{"type":"v1","addr":"172.21.15.63:6835","nonce":2711820189}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":5103,"qdb_cluster":[5103]},"id":2}]} 2024-09-21T07:01:24.557 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 25 2024-09-21T07:01:24.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.557+0000 7fe603119640 1 -- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe5e8078b90 msgr2=0x7fe5e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.557+0000 7fe603119640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe5e8078b90 0x7fe5e807b0a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8033000 tx=0x7fe5f8004730 comp rx=0 tx=0).stop 2024-09-21T07:01:24.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.557+0000 7fe603119640 1 -- 172.21.15.63:0/1628371835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc0d0920 msgr2=0x7fe5fc14f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.557+0000 7fe603119640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc0d0920 0x7fe5fc14f810 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00d740 tx=0x7fe5ec00dc00 comp rx=0 tx=0).stop 2024-09-21T07:01:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.557+0000 7fe603119640 1 -- 172.21.15.63:0/1628371835 shutdown_connections 2024-09-21T07:01:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.557+0000 7fe603119640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fe5e8078b90 0x7fe5e807b0a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.557+0000 7fe603119640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe5fc15c9a0 0x7fe5fc14fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.557+0000 7fe603119640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe5fc0d0920 0x7fe5fc14f810 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.557+0000 7fe603119640 1 --2- 172.21.15.63:0/1628371835 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fe5fc0b6ca0 0x7fe5fc0b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.557+0000 7fe603119640 1 -- 172.21.15.63:0/1628371835 >> 172.21.15.63:0/1628371835 conn(0x7fe5fc0b2f70 msgr2=0x7fe5fc15bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.557+0000 7fe603119640 1 -- 172.21.15.63:0/1628371835 shutdown_connections 2024-09-21T07:01:24.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.557+0000 7fe603119640 1 -- 172.21.15.63:0/1628371835 wait complete. 2024-09-21T07:01:24.571 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:01:24.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.685+0000 7f51b1d71640 1 -- 172.21.15.63:0/4182266477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51ac0b3b60 msgr2=0x7f51ac0ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.685+0000 7f51b1d71640 1 --2- 172.21.15.63:0/4182266477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51ac0b3b60 0x7f51ac0ce440 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f51a4005fd0 tx=0x7f51a402a940 comp rx=0 tx=0).stop 2024-09-21T07:01:24.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.685+0000 7f51b1d71640 1 -- 172.21.15.63:0/4182266477 shutdown_connections 2024-09-21T07:01:24.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.685+0000 7f51b1d71640 1 --2- 172.21.15.63:0/4182266477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51ac0b3b60 0x7f51ac0ce440 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.685+0000 7f51b1d71640 1 -- 172.21.15.63:0/4182266477 >> 172.21.15.63:0/4182266477 conn(0x7f51ac0b3fb0 msgr2=0x7f51ac0b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:24.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.685+0000 7f51b1d71640 1 -- 172.21.15.63:0/4182266477 shutdown_connections 2024-09-21T07:01:24.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.685+0000 7f51b1d71640 1 -- 172.21.15.63:0/4182266477 wait complete. 2024-09-21T07:01:24.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.687+0000 7f51b1d71640 1 Processor -- start 2024-09-21T07:01:24.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.687+0000 7f51b1d71640 1 -- start start 2024-09-21T07:01:24.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.688+0000 7f51b1d71640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51ac0b3750 0x7f51ac09c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.688+0000 7f51b1d71640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51ac0b3b60 0x7f51ac09d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.688+0000 7f51b1d71640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51ac153470 0x7f51ac09d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.688+0000 7f51b1d71640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac167cd0 con 0x7f51ac153470 2024-09-21T07:01:24.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.688+0000 7f51b1d71640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac167b50 con 0x7f51ac0b3750 2024-09-21T07:01:24.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.688+0000 7f51b1d71640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f51ac167e50 con 0x7f51ac0b3b60 2024-09-21T07:01:24.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.688+0000 7f51abfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51ac153470 0x7f51ac09d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.688+0000 7f51abfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51ac153470 0x7f51ac09d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38276/0 (socket says 172.21.15.63:38276) 2024-09-21T07:01:24.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.688+0000 7f51abfff640 1 -- 172.21.15.63:0/2022385458 learned_addr learned my addr 172.21.15.63:0/2022385458 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:24.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.689+0000 7f51ab7fe640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51ac0b3750 0x7f51ac09c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.689+0000 7f51aaffd640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51ac0b3b60 0x7f51ac09d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.689+0000 7f51abfff640 1 -- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51ac0b3b60 msgr2=0x7f51ac09d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.689+0000 7f51abfff640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51ac0b3b60 0x7f51ac09d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.689+0000 7f51abfff640 1 -- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51ac0b3750 msgr2=0x7f51ac09c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.689+0000 7f51abfff640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51ac0b3750 0x7f51ac09c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.689+0000 7f51abfff640 1 -- 172.21.15.63:0/2022385458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac09c870 con 0x7f51ac153470 2024-09-21T07:01:24.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.689+0000 7f51abfff640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51ac153470 0x7f51ac09d5d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009cd0 tx=0x7f51a4031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:24.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.689+0000 7f5193fff640 1 -- 172.21.15.63:0/2022385458 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a403e070 con 0x7f51ac153470 2024-09-21T07:01:24.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.689+0000 7f5193fff640 1 -- 172.21.15.63:0/2022385458 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51a4004540 con 0x7f51ac153470 2024-09-21T07:01:24.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.689+0000 7f51b1d71640 1 -- 172.21.15.63:0/2022385458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ac15f770 con 0x7f51ac153470 2024-09-21T07:01:24.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.689+0000 7f5193fff640 1 -- 172.21.15.63:0/2022385458 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4043460 con 0x7f51ac153470 2024-09-21T07:01:24.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.689+0000 7f51b1d71640 1 -- 172.21.15.63:0/2022385458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ac15fd30 con 0x7f51ac153470 2024-09-21T07:01:24.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.690+0000 7f51b1d71640 1 -- 172.21.15.63:0/2022385458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ac15f4c0 con 0x7f51ac153470 2024-09-21T07:01:24.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.691+0000 7f5193fff640 1 -- 172.21.15.63:0/2022385458 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f51a4043600 con 0x7f51ac153470 2024-09-21T07:01:24.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.691+0000 7f5193fff640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5198078b90 0x7f519807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:24.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.692+0000 7f5193fff640 1 -- 172.21.15.63:0/2022385458 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f51a40bc7b0 con 0x7f51ac153470 2024-09-21T07:01:24.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.692+0000 7f51ab7fe640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5198078b90 0x7f519807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:24.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.692+0000 7f51ab7fe640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5198078b90 0x7f519807b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f519c001720 tx=0x7f519c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:24.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.696+0000 7f5193fff640 1 -- 172.21.15.63:0/2022385458 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f51a4084660 con 0x7f51ac153470 2024-09-21T07:01:24.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.921+0000 7f51b1d71640 1 -- 172.21.15.63:0/2022385458 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51ac09aa40 con 0x7f51ac153470 2024-09-21T07:01:24.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.921+0000 7f5193fff640 1 -- 172.21.15.63:0/2022385458 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5220 (secure 0 0 0) 0x7f51a4089090 con 0x7f51ac153470 2024-09-21T07:01:24.923 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:24.923 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"btime":"2024-09-21T07:01:21:010053+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/585708774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":585708774},{"type":"v1","addr":"172.21.15.71:6836","nonce":585708774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4837,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2545148827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":2545148827},{"type":"v1","addr":"172.21.15.71:6837","nonce":2545148827}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/2618757202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2618757202},{"type":"v1","addr":"172.21.15.63:6834","nonce":2618757202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:01:17.210494+0000","modified":"2024-09-21T07:01:21.010048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6835/2711820189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2711820189},{"type":"v1","addr":"172.21.15.63:6835","nonce":2711820189}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":5103,"qdb_cluster":[5103]},"id":2}]} 2024-09-21T07:01:24.923 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 25 2024-09-21T07:01:24.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.923+0000 7f51b1d71640 1 -- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5198078b90 msgr2=0x7f519807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.923+0000 7f51b1d71640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5198078b90 0x7f519807b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f519c001720 tx=0x7f519c009040 comp rx=0 tx=0).stop 2024-09-21T07:01:24.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.923+0000 7f51b1d71640 1 -- 172.21.15.63:0/2022385458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51ac153470 msgr2=0x7f51ac09d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:24.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.923+0000 7f51b1d71640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51ac153470 0x7f51ac09d5d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009cd0 tx=0x7f51a4031e20 comp rx=0 tx=0).stop 2024-09-21T07:01:24.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.923+0000 7f51b1d71640 1 -- 172.21.15.63:0/2022385458 shutdown_connections 2024-09-21T07:01:24.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.923+0000 7f51b1d71640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5198078b90 0x7f519807b0a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.923+0000 7f51b1d71640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f51ac153470 0x7f51ac09d5d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.923+0000 7f51b1d71640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f51ac0b3b60 0x7f51ac09d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.923+0000 7f51b1d71640 1 --2- 172.21.15.63:0/2022385458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f51ac0b3750 0x7f51ac09c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:24.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.923+0000 7f51b1d71640 1 -- 172.21.15.63:0/2022385458 >> 172.21.15.63:0/2022385458 conn(0x7f51ac0b3fb0 msgr2=0x7f51ac15bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:24.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.924+0000 7f51b1d71640 1 -- 172.21.15.63:0/2022385458 shutdown_connections 2024-09-21T07:01:24.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:24.924+0000 7f51b1d71640 1 -- 172.21.15.63:0/2022385458 wait complete. 2024-09-21T07:01:24.936 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:01:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.052+0000 7f5ee3c64640 1 -- 172.21.15.63:0/888683432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ec40042a0 msgr2=0x7f5ec4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.052+0000 7f5ee3c64640 1 --2- 172.21.15.63:0/888683432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ec40042a0 0x7f5ec4004800 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0006b20 tx=0x7f5ec4005830 comp rx=0 tx=0).stop 2024-09-21T07:01:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.052+0000 7f5ee2201640 1 -- 172.21.15.63:0/888683432 reap_dead start 2024-09-21T07:01:25.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.052+0000 7f5ee3c64640 1 -- 172.21.15.63:0/888683432 shutdown_connections 2024-09-21T07:01:25.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.052+0000 7f5ee3c64640 1 -- 172.21.15.63:0/888683432 >> 172.21.15.63:0/888683432 conn(0x7f5edc06cf90 msgr2=0x7f5edc06d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:25.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.052+0000 7f5ee3c64640 1 -- 172.21.15.63:0/888683432 shutdown_connections 2024-09-21T07:01:25.055 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.052+0000 7f5ee3c64640 1 -- 172.21.15.63:0/888683432 wait complete. 2024-09-21T07:01:25.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.054+0000 7f5ee3c64640 1 Processor -- start 2024-09-21T07:01:25.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.054+0000 7f5ee3c64640 1 -- start start 2024-09-21T07:01:25.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.055+0000 7f5ee3c64640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ec40042a0 0x7f5edc14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:25.058 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.055+0000 7f5ee3c64640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5edc151b00 0x7f5edc0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.055+0000 7f5ee3c64640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5edc0b1860 0x7f5edc1f8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.055+0000 7f5ee3c64640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5edc0d1200 con 0x7f5ec40042a0 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.055+0000 7f5ee3c64640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5edc0d1080 con 0x7f5edc151b00 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.055+0000 7f5ee3c64640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f5edc0b3760 con 0x7f5edc0b1860 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5ee1a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ec40042a0 0x7f5edc14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5ee1a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ec40042a0 0x7f5edc14aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38288/0 (socket says 172.21.15.63:38288) 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5ee1a00640 1 -- 172.21.15.63:0/3075445631 learned_addr learned my addr 172.21.15.63:0/3075445631 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5ee2201640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5edc0b1860 0x7f5edc1f8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5ee11ff640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5edc151b00 0x7f5edc0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5ee1a00640 1 -- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5edc0b1860 msgr2=0x7f5edc1f8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5ee1a00640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5edc0b1860 0x7f5edc1f8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5ee1a00640 1 -- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5edc151b00 msgr2=0x7f5edc0b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5ee1a00640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5edc151b00 0x7f5edc0b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5ee1a00640 1 -- 172.21.15.63:0/3075445631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5edc0b1c70 con 0x7f5ec40042a0 2024-09-21T07:01:25.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5ee1a00640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ec40042a0 0x7f5edc14aab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4006290 tx=0x7f5ed4006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:25.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5eda7fc640 1 -- 172.21.15.63:0/3075445631 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4015070 con 0x7f5ec40042a0 2024-09-21T07:01:25.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5eda7fc640 1 -- 172.21.15.63:0/3075445631 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ed400fd60 con 0x7f5ec40042a0 2024-09-21T07:01:25.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5ee3c64640 1 -- 172.21.15.63:0/3075445631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5edc1525c0 con 0x7f5ec40042a0 2024-09-21T07:01:25.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5eda7fc640 1 -- 172.21.15.63:0/3075445631 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4011690 con 0x7f5ec40042a0 2024-09-21T07:01:25.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.056+0000 7f5ee3c64640 1 -- 172.21.15.63:0/3075445631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5edc152b80 con 0x7f5ec40042a0 2024-09-21T07:01:25.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.057+0000 7f5ee3c64640 1 -- 172.21.15.63:0/3075445631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5edc0b3cc0 con 0x7f5ec40042a0 2024-09-21T07:01:25.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.058+0000 7f5eda7fc640 1 -- 172.21.15.63:0/3075445631 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ed4011830 con 0x7f5ec40042a0 2024-09-21T07:01:25.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.059+0000 7f5eda7fc640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5ec8078b90 0x7f5ec807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:25.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.059+0000 7f5eda7fc640 1 -- 172.21.15.63:0/3075445631 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f5ed409be80 con 0x7f5ec40042a0 2024-09-21T07:01:25.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.059+0000 7f5ee11ff640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5ec8078b90 0x7f5ec807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:25.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.060+0000 7f5ee11ff640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5ec8078b90 0x7f5ec807b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0032000 tx=0x7f5ed0035040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:25.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.063+0000 7f5eda7fc640 1 -- 172.21.15.63:0/3075445631 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f5edc0b1c70 con 0x7f5ec40042a0 2024-09-21T07:01:25.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.251+0000 7f5ee3c64640 1 -- 172.21.15.63:0/3075445631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5edc0cffd0 con 0x7f5ec40042a0 2024-09-21T07:01:25.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.252+0000 7f5eda7fc640 1 -- 172.21.15.63:0/3075445631 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16750 (secure 0 0 0) 0x7f5ed4064260 con 0x7f5ec40042a0 2024-09-21T07:01:25.254 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:25.254 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":35,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:01:17.210533+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:01:01.276831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T07:01:02.103831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:6835/3748950985":"2024-09-22T07:01:15.789578+0000","172.21.15.63:6833/3748950985":"2024-09-22T07:01:15.789578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:01:25.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.254+0000 7f5ee3c64640 1 -- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5ec8078b90 msgr2=0x7f5ec807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.254+0000 7f5ee3c64640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5ec8078b90 0x7f5ec807b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0032000 tx=0x7f5ed0035040 comp rx=0 tx=0).stop 2024-09-21T07:01:25.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.254+0000 7f5ee3c64640 1 -- 172.21.15.63:0/3075445631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ec40042a0 msgr2=0x7f5edc14aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.254+0000 7f5ee3c64640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ec40042a0 0x7f5edc14aab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4006290 tx=0x7f5ed4006750 comp rx=0 tx=0).stop 2024-09-21T07:01:25.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.254+0000 7f5ee3c64640 1 -- 172.21.15.63:0/3075445631 shutdown_connections 2024-09-21T07:01:25.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.254+0000 7f5ee3c64640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f5ec8078b90 0x7f5ec807b0a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.254+0000 7f5ee3c64640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f5edc0b1860 0x7f5edc1f8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.254+0000 7f5ee3c64640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5edc151b00 0x7f5edc0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.254+0000 7f5ee3c64640 1 --2- 172.21.15.63:0/3075445631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5ec40042a0 0x7f5edc14aab0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.254+0000 7f5ee3c64640 1 -- 172.21.15.63:0/3075445631 >> 172.21.15.63:0/3075445631 conn(0x7f5edc06cf90 msgr2=0x7f5edc159f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:25.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.254+0000 7f5ee3c64640 1 -- 172.21.15.63:0/3075445631 shutdown_connections 2024-09-21T07:01:25.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.254+0000 7f5ee3c64640 1 -- 172.21.15.63:0/3075445631 wait complete. 2024-09-21T07:01:25.268 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:01:25.268 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:01:25.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.383+0000 7f03dfc8b640 1 -- 172.21.15.63:0/694747564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03d80b3b60 msgr2=0x7f03d809af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.383+0000 7f03dfc8b640 1 --2- 172.21.15.63:0/694747564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03d80b3b60 0x7f03d809af80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f03c8005fd0 tx=0x7f03c802a620 comp rx=0 tx=0).stop 2024-09-21T07:01:25.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.383+0000 7f03dfc8b640 1 -- 172.21.15.63:0/694747564 shutdown_connections 2024-09-21T07:01:25.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.383+0000 7f03dfc8b640 1 --2- 172.21.15.63:0/694747564 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03d80b3b60 0x7f03d809af80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.383+0000 7f03dfc8b640 1 --2- 172.21.15.63:0/694747564 >> v2:172.21.15.71:3300/0 conn(0x7f03d80b3750 0x7f03d809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.383+0000 7f03dfc8b640 1 -- 172.21.15.63:0/694747564 >> 172.21.15.63:0/694747564 conn(0x7f03d80b3fb0 msgr2=0x7f03d80b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:25.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.383+0000 7f03dfc8b640 1 -- 172.21.15.63:0/694747564 shutdown_connections 2024-09-21T07:01:25.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.383+0000 7f03dfc8b640 1 -- 172.21.15.63:0/694747564 wait complete. 2024-09-21T07:01:25.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.385+0000 7f03dfc8b640 1 Processor -- start 2024-09-21T07:01:25.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.385+0000 7f03dfc8b640 1 -- start start 2024-09-21T07:01:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03dfc8b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03d80b3750 0x7f03d809f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03dfc8b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f03d80b3b60 0x7f03d814af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03dfc8b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03d80b6020 0x7f03d814b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03dfc8b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f03d80ce0c0 con 0x7f03d80b6020 2024-09-21T07:01:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03dfc8b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f03d80cdf40 con 0x7f03d80b3750 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03dfc8b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f03d80ce240 con 0x7f03d80b3b60 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03de228640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03d80b6020 0x7f03d814b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03de228640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03d80b6020 0x7f03d814b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38314/0 (socket says 172.21.15.63:38314) 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03de228640 1 -- 172.21.15.63:0/921751144 learned_addr learned my addr 172.21.15.63:0/921751144 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03dda27640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03d80b3750 0x7f03d809f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03dd226640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f03d80b3b60 0x7f03d814af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03de228640 1 -- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f03d80b3b60 msgr2=0x7f03d814af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03de228640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f03d80b3b60 0x7f03d814af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03de228640 1 -- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03d80b3750 msgr2=0x7f03d809f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03de228640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03d80b3750 0x7f03d809f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.386+0000 7f03de228640 1 -- 172.21.15.63:0/921751144 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d809e580 con 0x7f03d80b6020 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.387+0000 7f03de228640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03d80b6020 0x7f03d814b4b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f03d000c730 tx=0x7f03d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.387+0000 7f03ce7fc640 1 -- 172.21.15.63:0/921751144 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0003b70 con 0x7f03d80b6020 2024-09-21T07:01:25.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.387+0000 7f03ce7fc640 1 -- 172.21.15.63:0/921751144 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03d0003d30 con 0x7f03d80b6020 2024-09-21T07:01:25.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.387+0000 7f03dfc8b640 1 -- 172.21.15.63:0/921751144 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d809e860 con 0x7f03d80b6020 2024-09-21T07:01:25.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.387+0000 7f03ce7fc640 1 -- 172.21.15.63:0/921751144 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0005330 con 0x7f03d80b6020 2024-09-21T07:01:25.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.387+0000 7f03dfc8b640 1 -- 172.21.15.63:0/921751144 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d809ee20 con 0x7f03d80b6020 2024-09-21T07:01:25.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.388+0000 7f03dfc8b640 1 -- 172.21.15.63:0/921751144 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d80ce760 con 0x7f03d80b6020 2024-09-21T07:01:25.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.389+0000 7f03ce7fc640 1 -- 172.21.15.63:0/921751144 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f03d00054d0 con 0x7f03d80b6020 2024-09-21T07:01:25.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.389+0000 7f03ce7fc640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f03bc078b90 0x7f03bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:25.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.390+0000 7f03ce7fc640 1 -- 172.21.15.63:0/921751144 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f03d009ab30 con 0x7f03d80b6020 2024-09-21T07:01:25.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.390+0000 7f03dda27640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f03bc078b90 0x7f03bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:25.392 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.390+0000 7f03dda27640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f03bc078b90 0x7f03bc07b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f03d40058c0 tx=0x7f03d4005850 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:25.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.394+0000 7f03ce7fc640 1 -- 172.21.15.63:0/921751144 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f03d0062f10 con 0x7f03d80b6020 2024-09-21T07:01:25.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.621+0000 7f03dfc8b640 1 -- 172.21.15.63:0/921751144 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03d809bb50 con 0x7f03d80b6020 2024-09-21T07:01:25.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.622+0000 7f03ce7fc640 1 -- 172.21.15.63:0/921751144 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5220 (secure 0 0 0) 0x7f03d0062810 con 0x7f03d80b6020 2024-09-21T07:01:25.624 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:25.624 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"btime":"2024-09-21T07:01:21:010053+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/585708774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":585708774},{"type":"v1","addr":"172.21.15.71:6836","nonce":585708774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4837,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2545148827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":2545148827},{"type":"v1","addr":"172.21.15.71:6837","nonce":2545148827}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/2618757202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2618757202},{"type":"v1","addr":"172.21.15.63:6834","nonce":2618757202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:01:17.210494+0000","modified":"2024-09-21T07:01:21.010048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6835/2711820189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2711820189},{"type":"v1","addr":"172.21.15.63:6835","nonce":2711820189}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":5103,"qdb_cluster":[5103]},"id":2}]} 2024-09-21T07:01:25.624 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 25 2024-09-21T07:01:25.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.624+0000 7f03dfc8b640 1 -- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f03bc078b90 msgr2=0x7f03bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.624+0000 7f03dfc8b640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f03bc078b90 0x7f03bc07b0a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f03d40058c0 tx=0x7f03d4005850 comp rx=0 tx=0).stop 2024-09-21T07:01:25.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.624+0000 7f03dfc8b640 1 -- 172.21.15.63:0/921751144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03d80b6020 msgr2=0x7f03d814b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.624+0000 7f03dfc8b640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03d80b6020 0x7f03d814b4b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f03d000c730 tx=0x7f03d000cbf0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.624+0000 7f03dfc8b640 1 -- 172.21.15.63:0/921751144 shutdown_connections 2024-09-21T07:01:25.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.624+0000 7f03dfc8b640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f03bc078b90 0x7f03bc07b0a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.624+0000 7f03dfc8b640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f03d80b6020 0x7f03d814b4b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.625+0000 7f03dfc8b640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f03d80b3b60 0x7f03d814af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.625+0000 7f03dfc8b640 1 --2- 172.21.15.63:0/921751144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03d80b3750 0x7f03d809f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.625+0000 7f03dfc8b640 1 -- 172.21.15.63:0/921751144 >> 172.21.15.63:0/921751144 conn(0x7f03d80b3fb0 msgr2=0x7f03d809c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:25.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.625+0000 7f03dfc8b640 1 -- 172.21.15.63:0/921751144 shutdown_connections 2024-09-21T07:01:25.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.625+0000 7f03dfc8b640 1 -- 172.21.15.63:0/921751144 wait complete. 2024-09-21T07:01:25.638 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:01:25.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.752+0000 7f6fac04d640 1 -- 172.21.15.63:0/1917042267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fa40d1300 msgr2=0x7f6fa406e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.752+0000 7f6fac04d640 1 --2- 172.21.15.63:0/1917042267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fa40d1300 0x7f6fa406e930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6fa406db40 tx=0x7f6f9c02aa30 comp rx=0 tx=0).stop 2024-09-21T07:01:25.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.752+0000 7f6fac04d640 1 -- 172.21.15.63:0/1917042267 shutdown_connections 2024-09-21T07:01:25.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.752+0000 7f6fac04d640 1 --2- 172.21.15.63:0/1917042267 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fa40d1300 0x7f6fa406e930 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.752+0000 7f6fac04d640 1 --2- 172.21.15.63:0/1917042267 >> v2:172.21.15.71:3300/0 conn(0x7f6fa40b3aa0 0x7f6fa40d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.752+0000 7f6fac04d640 1 -- 172.21.15.63:0/1917042267 >> 172.21.15.63:0/1917042267 conn(0x7f6fa40d45e0 msgr2=0x7f6fa40d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:25.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.752+0000 7f6fac04d640 1 -- 172.21.15.63:0/1917042267 shutdown_connections 2024-09-21T07:01:25.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.752+0000 7f6fac04d640 1 -- 172.21.15.63:0/1917042267 wait complete. 2024-09-21T07:01:25.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.754+0000 7f6fac04d640 1 Processor -- start 2024-09-21T07:01:25.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.754+0000 7f6fac04d640 1 -- start start 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.755+0000 7f6fac04d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fa40b3aa0 0x7f6fa4154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.755+0000 7f6fac04d640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6fa40b9aa0 0x7f6fa40b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fac04d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa4153ab0 0x7f6fa4153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fac04d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa40d03d0 con 0x7f6fa40b3aa0 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fac04d640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa408cb70 con 0x7f6fa4153ab0 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fac04d640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa406ee70 con 0x7f6fa40b9aa0 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fa9de9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fa40b3aa0 0x7f6fa4154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fa9de9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fa40b3aa0 0x7f6fa4154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38328/0 (socket says 172.21.15.63:38328) 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fa9de9640 1 -- 172.21.15.63:0/562594971 learned_addr learned my addr 172.21.15.63:0/562594971 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6faa5ea640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa4153ab0 0x7f6fa4153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fa95e8640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6fa40b9aa0 0x7f6fa40b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fa9de9640 1 -- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6fa40b9aa0 msgr2=0x7f6fa40b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fa9de9640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6fa40b9aa0 0x7f6fa40b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fa9de9640 1 -- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa4153ab0 msgr2=0x7f6fa4153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fa9de9640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa4153ab0 0x7f6fa4153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fa9de9640 1 -- 172.21.15.63:0/562594971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa4154400 con 0x7f6fa40b3aa0 2024-09-21T07:01:25.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fa95e8640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6fa40b9aa0 0x7f6fa40b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:01:25.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6faa5ea640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa4153ab0 0x7f6fa4153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:01:25.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fa9de9640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fa40b3aa0 0x7f6fa4154640 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000e7c0 tx=0x7f6fa000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:25.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6f9a7fc640 1 -- 172.21.15.63:0/562594971 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000cc60 con 0x7f6fa40b3aa0 2024-09-21T07:01:25.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6f9a7fc640 1 -- 172.21.15.63:0/562594971 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fa0010430 con 0x7f6fa40b3aa0 2024-09-21T07:01:25.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fac04d640 1 -- 172.21.15.63:0/562594971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa41f97c0 con 0x7f6fa40b3aa0 2024-09-21T07:01:25.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6f9a7fc640 1 -- 172.21.15.63:0/562594971 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0010840 con 0x7f6fa40b3aa0 2024-09-21T07:01:25.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.756+0000 7f6fac04d640 1 -- 172.21.15.63:0/562594971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa4150990 con 0x7f6fa40b3aa0 2024-09-21T07:01:25.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.757+0000 7f6fac04d640 1 -- 172.21.15.63:0/562594971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa406f2c0 con 0x7f6fa40b3aa0 2024-09-21T07:01:25.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.758+0000 7f6f9a7fc640 1 -- 172.21.15.63:0/562594971 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6fa00109e0 con 0x7f6fa40b3aa0 2024-09-21T07:01:25.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.759+0000 7f6f9a7fc640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6f88078b90 0x7f6f8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:25.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.759+0000 7f6f9a7fc640 1 -- 172.21.15.63:0/562594971 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f6fa009b790 con 0x7f6fa40b3aa0 2024-09-21T07:01:25.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.759+0000 7f6fa95e8640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6f88078b90 0x7f6f8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:25.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.759+0000 7f6fa95e8640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6f88078b90 0x7f6f8807b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6fa415d470 tx=0x7f6f94009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:25.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.763+0000 7f6f9a7fc640 1 -- 172.21.15.63:0/562594971 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f6fa0063b70 con 0x7f6fa40b3aa0 2024-09-21T07:01:25.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.989+0000 7f6fac04d640 1 -- 172.21.15.63:0/562594971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fa40d3100 con 0x7f6fa40b3aa0 2024-09-21T07:01:25.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.990+0000 7f6f9a7fc640 1 -- 172.21.15.63:0/562594971 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5220 (secure 0 0 0) 0x7f6fa0063470 con 0x7f6fa40b3aa0 2024-09-21T07:01:25.992 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:25.992 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"btime":"2024-09-21T07:01:21:010053+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/585708774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":585708774},{"type":"v1","addr":"172.21.15.71:6836","nonce":585708774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4837,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2545148827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":2545148827},{"type":"v1","addr":"172.21.15.71:6837","nonce":2545148827}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/2618757202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2618757202},{"type":"v1","addr":"172.21.15.63:6834","nonce":2618757202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T07:01:17.210494+0000","modified":"2024-09-21T07:01:21.010048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6835/2711820189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":2711820189},{"type":"v1","addr":"172.21.15.63:6835","nonce":2711820189}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":5103,"qdb_cluster":[5103]},"id":2}]} 2024-09-21T07:01:25.992 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 25 2024-09-21T07:01:25.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.992+0000 7f6fac04d640 1 -- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6f88078b90 msgr2=0x7f6f8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.992+0000 7f6fac04d640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6f88078b90 0x7f6f8807b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6fa415d470 tx=0x7f6f94009040 comp rx=0 tx=0).stop 2024-09-21T07:01:25.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.992+0000 7f6fac04d640 1 -- 172.21.15.63:0/562594971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fa40b3aa0 msgr2=0x7f6fa4154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:25.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.992+0000 7f6fac04d640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fa40b3aa0 0x7f6fa4154640 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000e7c0 tx=0x7f6fa000ec80 comp rx=0 tx=0).stop 2024-09-21T07:01:25.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.992+0000 7f6fac04d640 1 -- 172.21.15.63:0/562594971 shutdown_connections 2024-09-21T07:01:25.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.992+0000 7f6fac04d640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6f88078b90 0x7f6f8807b0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.992+0000 7f6fac04d640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6fa4153ab0 0x7f6fa4153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.992+0000 7f6fac04d640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6fa40b9aa0 0x7f6fa40b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.992+0000 7f6fac04d640 1 --2- 172.21.15.63:0/562594971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6fa40b3aa0 0x7f6fa4154640 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:25.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.992+0000 7f6fac04d640 1 -- 172.21.15.63:0/562594971 >> 172.21.15.63:0/562594971 conn(0x7f6fa40d45e0 msgr2=0x7f6fa40b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:25.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.992+0000 7f6fac04d640 1 -- 172.21.15.63:0/562594971 shutdown_connections 2024-09-21T07:01:25.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:25.992+0000 7f6fac04d640 1 -- 172.21.15.63:0/562594971 wait complete. 2024-09-21T07:01:26.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:01:26.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.120+0000 7ff1dac25640 1 -- 172.21.15.63:0/166879743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40b3aa0 msgr2=0x7ff1d40d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.120+0000 7ff1dac25640 1 --2- 172.21.15.63:0/166879743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40b3aa0 0x7ff1d40d2fd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009820 tx=0x7ff1c402a480 comp rx=0 tx=0).stop 2024-09-21T07:01:26.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.120+0000 7ff1dac25640 1 -- 172.21.15.63:0/166879743 shutdown_connections 2024-09-21T07:01:26.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.120+0000 7ff1dac25640 1 --2- 172.21.15.63:0/166879743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40b3aa0 0x7ff1d40d2fd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.120+0000 7ff1dac25640 1 -- 172.21.15.63:0/166879743 >> 172.21.15.63:0/166879743 conn(0x7ff1d40d45e0 msgr2=0x7ff1d40d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:26.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.120+0000 7ff1dac25640 1 -- 172.21.15.63:0/166879743 shutdown_connections 2024-09-21T07:01:26.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.120+0000 7ff1dac25640 1 -- 172.21.15.63:0/166879743 wait complete. 2024-09-21T07:01:26.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.122+0000 7ff1dac25640 1 Processor -- start 2024-09-21T07:01:26.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.122+0000 7ff1dac25640 1 -- start start 2024-09-21T07:01:26.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.123+0000 7ff1dac25640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40b3aa0 0x7ff1d4152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.123+0000 7ff1dac25640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff1d40b9aa0 0x7ff1d41f97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.123+0000 7ff1dac25640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d415de40 0x7ff1d40ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.123+0000 7ff1dac25640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d406f040 con 0x7ff1d40b3aa0 2024-09-21T07:01:26.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.123+0000 7ff1dac25640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d408cb70 con 0x7ff1d415de40 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.123+0000 7ff1dac25640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d406f1c0 con 0x7ff1d40b9aa0 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.123+0000 7ff1d89c1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40b3aa0 0x7ff1d4152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.123+0000 7ff1d89c1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40b3aa0 0x7ff1d4152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38346/0 (socket says 172.21.15.63:38346) 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.123+0000 7ff1d89c1640 1 -- 172.21.15.63:0/2623653841 learned_addr learned my addr 172.21.15.63:0/2623653841 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.123+0000 7ff1d91c2640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d415de40 0x7ff1d40ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.123+0000 7ff1d3fff640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff1d40b9aa0 0x7ff1d41f97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.124+0000 7ff1d89c1640 1 -- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff1d40b9aa0 msgr2=0x7ff1d41f97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.124+0000 7ff1d89c1640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff1d40b9aa0 0x7ff1d41f97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.124+0000 7ff1d89c1640 1 -- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d415de40 msgr2=0x7ff1d40ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.124+0000 7ff1d89c1640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d415de40 0x7ff1d40ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.124+0000 7ff1d89c1640 1 -- 172.21.15.63:0/2623653841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d40b5b00 con 0x7ff1d40b3aa0 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.124+0000 7ff1d91c2640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d415de40 0x7ff1d40ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.124+0000 7ff1d3fff640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff1d40b9aa0 0x7ff1d41f97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:26.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.124+0000 7ff1d89c1640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40b3aa0 0x7ff1d4152a40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009910 tx=0x7ff1c4004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:26.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.124+0000 7ff1d17fa640 1 -- 172.21.15.63:0/2623653841 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c403f070 con 0x7ff1d40b3aa0 2024-09-21T07:01:26.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.124+0000 7ff1d17fa640 1 -- 172.21.15.63:0/2623653841 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1c4004e50 con 0x7ff1d40b3aa0 2024-09-21T07:01:26.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.124+0000 7ff1dac25640 1 -- 172.21.15.63:0/2623653841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d4152f80 con 0x7ff1d40b3aa0 2024-09-21T07:01:26.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.124+0000 7ff1d17fa640 1 -- 172.21.15.63:0/2623653841 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4031950 con 0x7ff1d40b3aa0 2024-09-21T07:01:26.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.124+0000 7ff1dac25640 1 -- 172.21.15.63:0/2623653841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d40b5da0 con 0x7ff1d40b3aa0 2024-09-21T07:01:26.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.125+0000 7ff1dac25640 1 -- 172.21.15.63:0/2623653841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d40d2fd0 con 0x7ff1d40b3aa0 2024-09-21T07:01:26.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.126+0000 7ff1d17fa640 1 -- 172.21.15.63:0/2623653841 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1c4042070 con 0x7ff1d40b3aa0 2024-09-21T07:01:26.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.126+0000 7ff1d17fa640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff1b4078b90 0x7ff1b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.127+0000 7ff1d17fa640 1 -- 172.21.15.63:0/2623653841 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7ff1c40bbe90 con 0x7ff1d40b3aa0 2024-09-21T07:01:26.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.127+0000 7ff1d3fff640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff1b4078b90 0x7ff1b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.127+0000 7ff1d3fff640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff1b4078b90 0x7ff1b407b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff1d41564a0 tx=0x7ff1bc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:26.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.131+0000 7ff1d17fa640 1 -- 172.21.15.63:0/2623653841 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff1c4084300 con 0x7ff1d40b3aa0 2024-09-21T07:01:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.319+0000 7ff1dac25640 1 -- 172.21.15.63:0/2623653841 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1d40b17f0 con 0x7ff1d40b3aa0 2024-09-21T07:01:26.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.320+0000 7ff1d17fa640 1 -- 172.21.15.63:0/2623653841 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16750 (secure 0 0 0) 0x7ff1c4083c00 con 0x7ff1d40b3aa0 2024-09-21T07:01:26.322 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:26.323 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":35,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:01:17.210533+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-21T07:01:01.276831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-21T07:01:02.103831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:6835/3748950985":"2024-09-22T07:01:15.789578+0000","172.21.15.63:6833/3748950985":"2024-09-22T07:01:15.789578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:01:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.322+0000 7ff1dac25640 1 -- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff1b4078b90 msgr2=0x7ff1b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.322+0000 7ff1dac25640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff1b4078b90 0x7ff1b407b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff1d41564a0 tx=0x7ff1bc009040 comp rx=0 tx=0).stop 2024-09-21T07:01:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.322+0000 7ff1dac25640 1 -- 172.21.15.63:0/2623653841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40b3aa0 msgr2=0x7ff1d4152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.322+0000 7ff1dac25640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40b3aa0 0x7ff1d4152a40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009910 tx=0x7ff1c4004a50 comp rx=0 tx=0).stop 2024-09-21T07:01:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.322+0000 7ff1dac25640 1 -- 172.21.15.63:0/2623653841 shutdown_connections 2024-09-21T07:01:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.322+0000 7ff1dac25640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff1b4078b90 0x7ff1b407b0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.322+0000 7ff1dac25640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1d415de40 0x7ff1d40ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.322+0000 7ff1dac25640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff1d40b9aa0 0x7ff1d41f97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.322+0000 7ff1dac25640 1 --2- 172.21.15.63:0/2623653841 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40b3aa0 0x7ff1d4152a40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.322+0000 7ff1dac25640 1 -- 172.21.15.63:0/2623653841 >> 172.21.15.63:0/2623653841 conn(0x7ff1d40d45e0 msgr2=0x7ff1d406f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.323+0000 7ff1dac25640 1 -- 172.21.15.63:0/2623653841 shutdown_connections 2024-09-21T07:01:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.323+0000 7ff1dac25640 1 -- 172.21.15.63:0/2623653841 wait complete. 2024-09-21T07:01:26.337 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-21T07:01:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.454+0000 7f3b5c739640 1 -- 172.21.15.63:0/379804915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b3c004d40 msgr2=0x7f3b3c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.454+0000 7f3b5c739640 1 --2- 172.21.15.63:0/379804915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b3c004d40 0x7f3b3c005150 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009b20 tx=0x7f3b3c005830 comp rx=0 tx=0).stop 2024-09-21T07:01:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.454+0000 7f3b5acd6640 1 -- 172.21.15.63:0/379804915 reap_dead start 2024-09-21T07:01:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.454+0000 7f3b5c739640 1 -- 172.21.15.63:0/379804915 shutdown_connections 2024-09-21T07:01:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.454+0000 7f3b5c739640 1 -- 172.21.15.63:0/379804915 >> 172.21.15.63:0/379804915 conn(0x7f3b540d45e0 msgr2=0x7f3b540d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.454+0000 7f3b5c739640 1 -- 172.21.15.63:0/379804915 shutdown_connections 2024-09-21T07:01:26.456 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.454+0000 7f3b5c739640 1 -- 172.21.15.63:0/379804915 wait complete. 2024-09-21T07:01:26.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.456+0000 7f3b5c739640 1 Processor -- start 2024-09-21T07:01:26.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.456+0000 7f3b5c739640 1 -- start start 2024-09-21T07:01:26.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5c739640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b3c004d40 0x7f3b541f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5c739640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b540b3eb0 0x7f3b5414d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5c739640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b54160a40 0x7f3b54160e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5c739640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5406eff0 con 0x7f3b3c004d40 2024-09-21T07:01:26.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5c739640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5406ee70 con 0x7f3b540b3eb0 2024-09-21T07:01:26.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5c739640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5406f170 con 0x7f3b54160a40 2024-09-21T07:01:26.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5a4d5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b3c004d40 0x7f3b541f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5a4d5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b3c004d40 0x7f3b541f5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38362/0 (socket says 172.21.15.63:38362) 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5a4d5640 1 -- 172.21.15.63:0/2988879762 learned_addr learned my addr 172.21.15.63:0/2988879762 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5acd6640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b54160a40 0x7f3b54160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b59cd4640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b540b3eb0 0x7f3b5414d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5a4d5640 1 -- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b54160a40 msgr2=0x7f3b54160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5a4d5640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b54160a40 0x7f3b54160e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5a4d5640 1 -- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b540b3eb0 msgr2=0x7f3b5414d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5a4d5640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b540b3eb0 0x7f3b5414d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.457+0000 7f3b5a4d5640 1 -- 172.21.15.63:0/2988879762 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b54161390 con 0x7f3b3c004d40 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.458+0000 7f3b5a4d5640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b3c004d40 0x7f3b541f5470 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3b44011cb0 tx=0x7f3b4400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.458+0000 7f3b52ffd640 1 -- 172.21.15.63:0/2988879762 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44003e40 con 0x7f3b3c004d40 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.458+0000 7f3b52ffd640 1 -- 172.21.15.63:0/2988879762 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b44004050 con 0x7f3b3c004d40 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.458+0000 7f3b5c739640 1 -- 172.21.15.63:0/2988879762 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5414df30 con 0x7f3b3c004d40 2024-09-21T07:01:26.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.458+0000 7f3b52ffd640 1 -- 172.21.15.63:0/2988879762 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44004480 con 0x7f3b3c004d40 2024-09-21T07:01:26.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.458+0000 7f3b5c739640 1 -- 172.21.15.63:0/2988879762 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b540c9700 con 0x7f3b3c004d40 2024-09-21T07:01:26.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.459+0000 7f3b5c739640 1 -- 172.21.15.63:0/2988879762 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5406e930 con 0x7f3b3c004d40 2024-09-21T07:01:26.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.460+0000 7f3b52ffd640 1 -- 172.21.15.63:0/2988879762 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3b44004620 con 0x7f3b3c004d40 2024-09-21T07:01:26.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.460+0000 7f3b52ffd640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3b40078b90 0x7f3b4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.460+0000 7f3b52ffd640 1 -- 172.21.15.63:0/2988879762 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f3b4409c4f0 con 0x7f3b3c004d40 2024-09-21T07:01:26.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.461+0000 7f3b59cd4640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3b40078b90 0x7f3b4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.461+0000 7f3b59cd4640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3b40078b90 0x7f3b4007b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3b48000c00 tx=0x7f3b48006040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:26.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.465+0000 7f3b52ffd640 1 -- 172.21.15.63:0/2988879762 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f3b54161390 con 0x7f3b3c004d40 2024-09-21T07:01:26.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.687+0000 7f3b5c739640 1 -- 172.21.15.63:0/2988879762 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3b5415d750 con 0x7f3b3c004d40 2024-09-21T07:01:26.689 INFO:tasks.ceph.mon.a.smithi063.stderr:2024-09-21T07:01:26.688+0000 7fed43401640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T07:01:26.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.690+0000 7f3b52ffd640 1 -- 172.21.15.63:0/2988879762 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f3b440648c0 con 0x7f3b3c004d40 2024-09-21T07:01:26.691 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T07:01:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.693+0000 7f3b5c739640 1 -- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3b40078b90 msgr2=0x7f3b4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.693+0000 7f3b5c739640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3b40078b90 0x7f3b4007b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3b48000c00 tx=0x7f3b48006040 comp rx=0 tx=0).stop 2024-09-21T07:01:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.693+0000 7f3b5c739640 1 -- 172.21.15.63:0/2988879762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b3c004d40 msgr2=0x7f3b541f5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.693+0000 7f3b5c739640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b3c004d40 0x7f3b541f5470 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3b44011cb0 tx=0x7f3b4400f790 comp rx=0 tx=0).stop 2024-09-21T07:01:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.693+0000 7f3b5c739640 1 -- 172.21.15.63:0/2988879762 shutdown_connections 2024-09-21T07:01:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.693+0000 7f3b5c739640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f3b40078b90 0x7f3b4007b0a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.693+0000 7f3b5c739640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f3b54160a40 0x7f3b54160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.693+0000 7f3b5c739640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3b540b3eb0 0x7f3b5414d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.693+0000 7f3b5c739640 1 --2- 172.21.15.63:0/2988879762 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b3c004d40 0x7f3b541f5470 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.693+0000 7f3b5c739640 1 -- 172.21.15.63:0/2988879762 >> 172.21.15.63:0/2988879762 conn(0x7f3b540d45e0 msgr2=0x7f3b540b9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:26.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.693+0000 7f3b5c739640 1 -- 172.21.15.63:0/2988879762 shutdown_connections 2024-09-21T07:01:26.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.693+0000 7f3b5c739640 1 -- 172.21.15.63:0/2988879762 wait complete. 2024-09-21T07:01:26.696 INFO:tasks.ceph.mds.a.smithi063.stderr: -518> 2024-09-21T07:01:22.829+0000 7feb5fd3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T07:01:26.707 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T07:01:26.752 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2024-09-21T07:01:26.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.829+0000 7f17ef713640 1 -- 172.21.15.63:0/1739153171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d4005270 msgr2=0x7f17d400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.829+0000 7f17ef713640 1 --2- 172.21.15.63:0/1739153171 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d4005270 0x7f17d400b9c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f17e0005fd0 tx=0x7f17d4005830 comp rx=0 tx=0).stop 2024-09-21T07:01:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.829+0000 7f17edcb0640 1 -- 172.21.15.63:0/1739153171 reap_dead start 2024-09-21T07:01:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.830+0000 7f17ef713640 1 -- 172.21.15.63:0/1739153171 shutdown_connections 2024-09-21T07:01:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.830+0000 7f17ef713640 1 -- 172.21.15.63:0/1739153171 >> 172.21.15.63:0/1739153171 conn(0x7f17e80d45e0 msgr2=0x7f17e80d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.830+0000 7f17ef713640 1 -- 172.21.15.63:0/1739153171 shutdown_connections 2024-09-21T07:01:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.830+0000 7f17ef713640 1 -- 172.21.15.63:0/1739153171 wait complete. 2024-09-21T07:01:26.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.833+0000 7f17ef713640 1 Processor -- start 2024-09-21T07:01:26.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.833+0000 7f17ef713640 1 -- start start 2024-09-21T07:01:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ef713640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d4005270 0x7f17e80b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ef713640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e81f8f20 0x7f17e81f9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ef713640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f17e80b1200 0x7f17e80b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ef713640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f17e808c960 con 0x7f17d4005270 2024-09-21T07:01:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ef713640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f17e80d1570 con 0x7f17e81f8f20 2024-09-21T07:01:26.837 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ef713640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f17e808cae0 con 0x7f17e80b1200 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ed4af640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d4005270 0x7f17e80b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ed4af640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d4005270 0x7f17e80b3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38410/0 (socket says 172.21.15.63:38410) 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ed4af640 1 -- 172.21.15.63:0/3979615238 learned_addr learned my addr 172.21.15.63:0/3979615238 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17eccae640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e81f8f20 0x7f17e81f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17edcb0640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f17e80b1200 0x7f17e80b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ed4af640 1 -- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f17e80b1200 msgr2=0x7f17e80b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ed4af640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f17e80b1200 0x7f17e80b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ed4af640 1 -- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e81f8f20 msgr2=0x7f17e81f9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ed4af640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e81f8f20 0x7f17e81f9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.834+0000 7f17ed4af640 1 -- 172.21.15.63:0/3979615238 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e80b1b50 con 0x7f17d4005270 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.835+0000 7f17ed4af640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d4005270 0x7f17e80b3ee0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f17e400e5c0 tx=0x7f17e4001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.835+0000 7f17ddffb640 1 -- 172.21.15.63:0/3979615238 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4015070 con 0x7f17d4005270 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.835+0000 7f17ddffb640 1 -- 172.21.15.63:0/3979615238 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17e400c9e0 con 0x7f17d4005270 2024-09-21T07:01:26.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.835+0000 7f17ef713640 1 -- 172.21.15.63:0/3979615238 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e80b6dd0 con 0x7f17d4005270 2024-09-21T07:01:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.835+0000 7f17ddffb640 1 -- 172.21.15.63:0/3979615238 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e400cdf0 con 0x7f17d4005270 2024-09-21T07:01:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.835+0000 7f17ef713640 1 -- 172.21.15.63:0/3979615238 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e80b6010 con 0x7f17d4005270 2024-09-21T07:01:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.836+0000 7f17ef713640 1 -- 172.21.15.63:0/3979615238 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e80d2fd0 con 0x7f17d4005270 2024-09-21T07:01:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.837+0000 7f17ddffb640 1 -- 172.21.15.63:0/3979615238 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f17e4018070 con 0x7f17d4005270 2024-09-21T07:01:26.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.837+0000 7f17ddffb640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f17cc078b90 0x7f17cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.838+0000 7f17ddffb640 1 -- 172.21.15.63:0/3979615238 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5881+0+0 (secure 0 0 0) 0x7f17e409b0f0 con 0x7f17d4005270 2024-09-21T07:01:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.838+0000 7f17eccae640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f17cc078b90 0x7f17cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:26.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.838+0000 7f17eccae640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f17cc078b90 0x7f17cc07b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f17e80744b0 tx=0x7f17d8006b70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:26.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:26.842+0000 7f17ddffb640 1 -- 172.21.15.63:0/3979615238 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f17e80b1b50 con 0x7f17d4005270 2024-09-21T07:01:27.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.069+0000 7f17ef713640 1 -- 172.21.15.63:0/3979615238 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f17e80d1720 con 0x7f17d4005270 2024-09-21T07:01:27.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.691+0000 7f17ddffb640 1 -- 172.21.15.63:0/3979615238 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f17e4062ec0 con 0x7f17d4005270 2024-09-21T07:01:27.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.694+0000 7f17ef713640 1 -- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f17cc078b90 msgr2=0x7f17cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:27.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.694+0000 7f17ef713640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f17cc078b90 0x7f17cc07b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f17e80744b0 tx=0x7f17d8006b70 comp rx=0 tx=0).stop 2024-09-21T07:01:27.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.694+0000 7f17ef713640 1 -- 172.21.15.63:0/3979615238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d4005270 msgr2=0x7f17e80b3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:27.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.694+0000 7f17ef713640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d4005270 0x7f17e80b3ee0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f17e400e5c0 tx=0x7f17e4001950 comp rx=0 tx=0).stop 2024-09-21T07:01:27.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.694+0000 7f17ef713640 1 -- 172.21.15.63:0/3979615238 shutdown_connections 2024-09-21T07:01:27.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.694+0000 7f17ef713640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f17cc078b90 0x7f17cc07b0a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:27.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.694+0000 7f17ef713640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f17e80b1200 0x7f17e80b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:27.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.694+0000 7f17ef713640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f17e81f8f20 0x7f17e81f9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:27.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.694+0000 7f17ef713640 1 --2- 172.21.15.63:0/3979615238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17d4005270 0x7f17e80b3ee0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:27.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.694+0000 7f17ef713640 1 -- 172.21.15.63:0/3979615238 >> 172.21.15.63:0/3979615238 conn(0x7f17e80d45e0 msgr2=0x7f17e80b7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:27.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.694+0000 7f17ef713640 1 -- 172.21.15.63:0/3979615238 shutdown_connections 2024-09-21T07:01:27.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.694+0000 7f17ef713640 1 -- 172.21.15.63:0/3979615238 wait complete. 2024-09-21T07:01:27.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T07:01:27.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.833+0000 7fcccd6a9640 1 -- 172.21.15.63:0/1409243209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccc80d1770 msgr2=0x7fccc80b9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:27.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.833+0000 7fcccd6a9640 1 --2- 172.21.15.63:0/1409243209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccc80d1770 0x7fccc80b9c40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009820 tx=0x7fccbc02a510 comp rx=0 tx=0).stop 2024-09-21T07:01:27.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.833+0000 7fcccd6a9640 1 -- 172.21.15.63:0/1409243209 shutdown_connections 2024-09-21T07:01:27.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.833+0000 7fcccd6a9640 1 --2- 172.21.15.63:0/1409243209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccc80d1770 0x7fccc80b9c40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:27.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.833+0000 7fcccd6a9640 1 -- 172.21.15.63:0/1409243209 >> 172.21.15.63:0/1409243209 conn(0x7fccc80d4680 msgr2=0x7fccc80d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:27.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.833+0000 7fcccd6a9640 1 -- 172.21.15.63:0/1409243209 shutdown_connections 2024-09-21T07:01:27.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.833+0000 7fcccd6a9640 1 -- 172.21.15.63:0/1409243209 wait complete. 2024-09-21T07:01:27.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.835+0000 7fcccd6a9640 1 Processor -- start 2024-09-21T07:01:27.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.835+0000 7fcccd6a9640 1 -- start start 2024-09-21T07:01:27.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.836+0000 7fcccd6a9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccc80b35b0 0x7fccc81f9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:27.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.836+0000 7fcccd6a9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccc80cf6e0 0x7fccc80b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:27.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.836+0000 7fcccd6a9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fccc81e7990 0x7fccc80b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:27.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.836+0000 7fcccd6a9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fccc80d1f40 con 0x7fccc80b35b0 2024-09-21T07:01:27.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.836+0000 7fcccd6a9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fccc80d1dc0 con 0x7fccc81e7990 2024-09-21T07:01:27.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.836+0000 7fcccd6a9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fccc80d0200 con 0x7fccc80cf6e0 2024-09-21T07:01:27.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.836+0000 7fccc6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccc80b35b0 0x7fccc81f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:27.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.836+0000 7fccc6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccc80b35b0 0x7fccc81f9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38440/0 (socket says 172.21.15.63:38440) 2024-09-21T07:01:27.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.836+0000 7fccc6ffd640 1 -- 172.21.15.63:0/3122388865 learned_addr learned my addr 172.21.15.63:0/3122388865 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:27.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.836+0000 7fccc77fe640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fccc81e7990 0x7fccc80b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:27.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.837+0000 7fccc67fc640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccc80cf6e0 0x7fccc80b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:27.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.837+0000 7fccc6ffd640 1 -- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccc80cf6e0 msgr2=0x7fccc80b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:27.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.837+0000 7fccc6ffd640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccc80cf6e0 0x7fccc80b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:27.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.837+0000 7fccc6ffd640 1 -- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fccc81e7990 msgr2=0x7fccc80b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:27.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.837+0000 7fccc6ffd640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fccc81e7990 0x7fccc80b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:27.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.837+0000 7fccc6ffd640 1 -- 172.21.15.63:0/3122388865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc81f5a80 con 0x7fccc80b35b0 2024-09-21T07:01:27.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.837+0000 7fccc67fc640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccc80cf6e0 0x7fccc80b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:27.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.837+0000 7fccc6ffd640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccc80b35b0 0x7fccc81f9310 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fccb800c390 tx=0x7fccb800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:27.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.837+0000 7fccaf7fe640 1 -- 172.21.15.63:0/3122388865 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb8017070 con 0x7fccc80b35b0 2024-09-21T07:01:27.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.837+0000 7fccaf7fe640 1 -- 172.21.15.63:0/3122388865 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccb80035f0 con 0x7fccc80b35b0 2024-09-21T07:01:27.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.837+0000 7fcccd6a9640 1 -- 172.21.15.63:0/3122388865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc81f5d60 con 0x7fccc80b35b0 2024-09-21T07:01:27.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.837+0000 7fccaf7fe640 1 -- 172.21.15.63:0/3122388865 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb8003a40 con 0x7fccc80b35b0 2024-09-21T07:01:27.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.837+0000 7fcccd6a9640 1 -- 172.21.15.63:0/3122388865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc81e7dd0 con 0x7fccc80b35b0 2024-09-21T07:01:27.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.838+0000 7fcccd6a9640 1 -- 172.21.15.63:0/3122388865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc80b9c40 con 0x7fccc80b35b0 2024-09-21T07:01:27.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.839+0000 7fccaf7fe640 1 -- 172.21.15.63:0/3122388865 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fccb801a070 con 0x7fccc80b35b0 2024-09-21T07:01:27.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.839+0000 7fccaf7fe640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fccb4078b90 0x7fccb407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:27.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.839+0000 7fccaf7fe640 1 -- 172.21.15.63:0/3122388865 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5881+0+0 (secure 0 0 0) 0x7fccb8099f30 con 0x7fccc80b35b0 2024-09-21T07:01:27.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.840+0000 7fccc67fc640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fccb4078b90 0x7fccb407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:27.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.840+0000 7fccc67fc640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fccb4078b90 0x7fccb407b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fccbc034000 tx=0x7fccbc004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:27.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:27.844+0000 7fccaf7fe640 1 -- 172.21.15.63:0/3122388865 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fccc80d2e40 con 0x7fccc80b35b0 2024-09-21T07:01:28.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.032+0000 7fcccd6a9640 1 -- 172.21.15.63:0/3122388865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fccc808e720 con 0x7fccc80b35b0 2024-09-21T07:01:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.879+0000 7fccaf7fe640 1 -- 172.21.15.63:0/3122388865 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) ==== 181+0+0 (secure 0 0 0) 0x7fccb8061d10 con 0x7fccc80b35b0 2024-09-21T07:01:28.881 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2024-09-21T07:01:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.884+0000 7fcccd6a9640 1 -- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fccb4078b90 msgr2=0x7fccb407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.884+0000 7fcccd6a9640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fccb4078b90 0x7fccb407b0a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fccbc034000 tx=0x7fccbc004730 comp rx=0 tx=0).stop 2024-09-21T07:01:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.884+0000 7fcccd6a9640 1 -- 172.21.15.63:0/3122388865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccc80b35b0 msgr2=0x7fccc81f9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:28.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.884+0000 7fcccd6a9640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccc80b35b0 0x7fccc81f9310 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fccb800c390 tx=0x7fccb800c850 comp rx=0 tx=0).stop 2024-09-21T07:01:28.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.885+0000 7fcccd6a9640 1 -- 172.21.15.63:0/3122388865 shutdown_connections 2024-09-21T07:01:28.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.885+0000 7fcccd6a9640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fccb4078b90 0x7fccb407b0a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:28.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.885+0000 7fcccd6a9640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fccc81e7990 0x7fccc80b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:28.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.885+0000 7fcccd6a9640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fccc80cf6e0 0x7fccc80b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:28.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.885+0000 7fcccd6a9640 1 --2- 172.21.15.63:0/3122388865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fccc80b35b0 0x7fccc81f9310 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:28.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.885+0000 7fcccd6a9640 1 -- 172.21.15.63:0/3122388865 >> 172.21.15.63:0/3122388865 conn(0x7fccc80d4680 msgr2=0x7fccc8161b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:28.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.886+0000 7fcccd6a9640 1 -- 172.21.15.63:0/3122388865 shutdown_connections 2024-09-21T07:01:28.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:28.887+0000 7fcccd6a9640 1 -- 172.21.15.63:0/3122388865 wait complete. 2024-09-21T07:01:28.904 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T07:01:29.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.030+0000 7fa93f390640 1 -- 172.21.15.63:0/2776585308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9380ce4c0 msgr2=0x7fa93815edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:29.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.030+0000 7fa93f390640 1 --2- 172.21.15.63:0/2776585308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9380ce4c0 0x7fa93815edd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009830 tx=0x7fa92c02a5c0 comp rx=0 tx=0).stop 2024-09-21T07:01:29.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.030+0000 7fa93f390640 1 -- 172.21.15.63:0/2776585308 shutdown_connections 2024-09-21T07:01:29.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.030+0000 7fa93f390640 1 --2- 172.21.15.63:0/2776585308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9380ce4c0 0x7fa93815edd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:29.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.030+0000 7fa93f390640 1 -- 172.21.15.63:0/2776585308 >> 172.21.15.63:0/2776585308 conn(0x7fa9380b2f70 msgr2=0x7fa9380b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:29.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.031+0000 7fa93f390640 1 -- 172.21.15.63:0/2776585308 shutdown_connections 2024-09-21T07:01:29.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.031+0000 7fa93f390640 1 -- 172.21.15.63:0/2776585308 wait complete. 2024-09-21T07:01:29.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.032+0000 7fa93f390640 1 Processor -- start 2024-09-21T07:01:29.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.032+0000 7fa93f390640 1 -- start start 2024-09-21T07:01:29.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93f390640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9380b4270 0x7fa9380c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:29.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93f390640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9380b6c00 0x7fa9380c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:29.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93f390640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa9381539d0 0x7fa938153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:29.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93f390640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa9380d0040 con 0x7fa9380b6c00 2024-09-21T07:01:29.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93f390640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa9380cfec0 con 0x7fa9380b4270 2024-09-21T07:01:29.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93f390640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fa9380b4d90 con 0x7fa9381539d0 2024-09-21T07:01:29.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93c92b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9380b6c00 0x7fa9380c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:29.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93c92b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9380b6c00 0x7fa9380c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42534/0 (socket says 172.21.15.63:42534) 2024-09-21T07:01:29.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93c92b640 1 -- 172.21.15.63:0/1545551796 learned_addr learned my addr 172.21.15.63:0/1545551796 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:29.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93d12c640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9380b4270 0x7fa9380c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:29.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93d92d640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa9381539d0 0x7fa938153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:29.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93c92b640 1 -- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa9381539d0 msgr2=0x7fa938153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:29.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93c92b640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa9381539d0 0x7fa938153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:29.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93c92b640 1 -- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9380b4270 msgr2=0x7fa9380c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:29.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93c92b640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9380b4270 0x7fa9380c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:29.038 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93c92b640 1 -- 172.21.15.63:0/1545551796 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9381f6e90 con 0x7fa9380b6c00 2024-09-21T07:01:29.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93d92d640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa9381539d0 0x7fa938153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:01:29.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93c92b640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9380b6c00 0x7fa9380c7790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa92c000c00 tx=0x7fa92c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:29.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa935ffb640 1 -- 172.21.15.63:0/1545551796 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c031d60 con 0x7fa9380b6c00 2024-09-21T07:01:29.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa935ffb640 1 -- 172.21.15.63:0/1545551796 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa92c033e10 con 0x7fa9380b6c00 2024-09-21T07:01:29.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa935ffb640 1 -- 172.21.15.63:0/1545551796 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c033310 con 0x7fa9380b6c00 2024-09-21T07:01:29.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.034+0000 7fa93f390640 1 -- 172.21.15.63:0/1545551796 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9381f7170 con 0x7fa9380b6c00 2024-09-21T07:01:29.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.035+0000 7fa93f390640 1 -- 172.21.15.63:0/1545551796 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa938152dc0 con 0x7fa9380b6c00 2024-09-21T07:01:29.039 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.036+0000 7fa93f390640 1 -- 172.21.15.63:0/1545551796 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9381f6c00 con 0x7fa9380b6c00 2024-09-21T07:01:29.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.037+0000 7fa935ffb640 1 -- 172.21.15.63:0/1545551796 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa92c0334b0 con 0x7fa9380b6c00 2024-09-21T07:01:29.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.037+0000 7fa935ffb640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa924078b90 0x7fa92407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:29.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.037+0000 7fa935ffb640 1 -- 172.21.15.63:0/1545551796 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5443+0+0 (secure 0 0 0) 0x7fa92c0bbf70 con 0x7fa9380b6c00 2024-09-21T07:01:29.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.037+0000 7fa93d12c640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa924078b90 0x7fa92407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:29.040 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.038+0000 7fa93d12c640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa924078b90 0x7fa92407b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9300015e0 tx=0x7fa930009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:29.043 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.042+0000 7fa935ffb640 1 -- 172.21.15.63:0/1545551796 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fa92c03f030 con 0x7fa9380b6c00 2024-09-21T07:01:29.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.237+0000 7fa93f390640 1 -- 172.21.15.63:0/1545551796 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa93815edd0 con 0x7fa9380b6c00 2024-09-21T07:01:29.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.881+0000 7fa935ffb640 1 -- 172.21.15.63:0/1545551796 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) ==== 169+0+0 (secure 0 0 0) 0x7fa92c0845d0 con 0x7fa9380b6c00 2024-09-21T07:01:29.883 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2024-09-21T07:01:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.884+0000 7fa93f390640 1 -- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa924078b90 msgr2=0x7fa92407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.884+0000 7fa93f390640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa924078b90 0x7fa92407b0a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9300015e0 tx=0x7fa930009040 comp rx=0 tx=0).stop 2024-09-21T07:01:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.884+0000 7fa93f390640 1 -- 172.21.15.63:0/1545551796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9380b6c00 msgr2=0x7fa9380c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.884+0000 7fa93f390640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9380b6c00 0x7fa9380c7790 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa92c000c00 tx=0x7fa92c033c20 comp rx=0 tx=0).stop 2024-09-21T07:01:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.884+0000 7fa93f390640 1 -- 172.21.15.63:0/1545551796 shutdown_connections 2024-09-21T07:01:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.884+0000 7fa93f390640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fa924078b90 0x7fa92407b0a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.884+0000 7fa93f390640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fa9381539d0 0x7fa938153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.884+0000 7fa93f390640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9380b6c00 0x7fa9380c7790 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.884+0000 7fa93f390640 1 --2- 172.21.15.63:0/1545551796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9380b4270 0x7fa9380c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:29.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.884+0000 7fa93f390640 1 -- 172.21.15.63:0/1545551796 >> 172.21.15.63:0/1545551796 conn(0x7fa9380b2f70 msgr2=0x7fa9380719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:29.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.884+0000 7fa93f390640 1 -- 172.21.15.63:0/1545551796 shutdown_connections 2024-09-21T07:01:29.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:29.884+0000 7fa93f390640 1 -- 172.21.15.63:0/1545551796 wait complete. 2024-09-21T07:01:29.903 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-21T07:01:30.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.024+0000 7fc375c25640 1 -- 172.21.15.63:0/436875502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3700b9de0 msgr2=0x7fc3700d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:30.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.024+0000 7fc375c25640 1 --2- 172.21.15.63:0/436875502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3700b9de0 0x7fc3700d1140 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc3640098e0 tx=0x7fc36402a5d0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.024+0000 7fc375c25640 1 -- 172.21.15.63:0/436875502 shutdown_connections 2024-09-21T07:01:30.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.024+0000 7fc375c25640 1 --2- 172.21.15.63:0/436875502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3700b9de0 0x7fc3700d1140 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.024+0000 7fc375c25640 1 --2- 172.21.15.63:0/436875502 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc37008c960 0x7fc3700d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.024+0000 7fc375c25640 1 -- 172.21.15.63:0/436875502 >> 172.21.15.63:0/436875502 conn(0x7fc3700d4580 msgr2=0x7fc3700d4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.024+0000 7fc375c25640 1 -- 172.21.15.63:0/436875502 shutdown_connections 2024-09-21T07:01:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.024+0000 7fc375c25640 1 -- 172.21.15.63:0/436875502 wait complete. 2024-09-21T07:01:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.026+0000 7fc375c25640 1 Processor -- start 2024-09-21T07:01:30.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.026+0000 7fc375c25640 1 -- start start 2024-09-21T07:01:30.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.027+0000 7fc375c25640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc37006e8e0 0x7fc3700b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:30.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.027+0000 7fc375c25640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37008c960 0x7fc370155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:30.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.027+0000 7fc375c25640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3700b9de0 0x7fc37014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:30.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.027+0000 7fc375c25640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc3700d0510 con 0x7fc3700b9de0 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.027+0000 7fc375c25640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3700d0390 con 0x7fc37008c960 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.027+0000 7fc375c25640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc37006f400 con 0x7fc37006e8e0 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc36ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3700b9de0 0x7fc37014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc36f7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc37006e8e0 0x7fc3700b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc36f7fe640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc37006e8e0 0x7fc3700b6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3301/0 says I am v2:172.21.15.63:54422/0 (socket says 172.21.15.63:54422) 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc36ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3700b9de0 0x7fc37014d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42554/0 (socket says 172.21.15.63:42554) 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc36f7fe640 1 -- 172.21.15.63:0/1342086444 learned_addr learned my addr 172.21.15.63:0/1342086444 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc36effd640 1 --2- 172.21.15.63:0/1342086444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37008c960 0x7fc370155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc36ffff640 1 -- 172.21.15.63:0/1342086444 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc37006e8e0 msgr2=0x7fc3700b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc36ffff640 1 --2- 172.21.15.63:0/1342086444 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc37006e8e0 0x7fc3700b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc36ffff640 1 -- 172.21.15.63:0/1342086444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37008c960 msgr2=0x7fc370155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc36ffff640 1 --2- 172.21.15.63:0/1342086444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37008c960 0x7fc370155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc36ffff640 1 -- 172.21.15.63:0/1342086444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3700ce080 con 0x7fc3700b9de0 2024-09-21T07:01:30.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc36ffff640 1 --2- 172.21.15.63:0/1342086444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3700b9de0 0x7fc37014d0c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc37008e940 tx=0x7fc36800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc357fff640 1 -- 172.21.15.63:0/1342086444 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368003b70 con 0x7fc3700b9de0 2024-09-21T07:01:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc357fff640 1 -- 172.21.15.63:0/1342086444 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc368003d10 con 0x7fc3700b9de0 2024-09-21T07:01:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc375c25640 1 -- 172.21.15.63:0/1342086444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3700cd7e0 con 0x7fc3700b9de0 2024-09-21T07:01:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc357fff640 1 -- 172.21.15.63:0/1342086444 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368005330 con 0x7fc3700b9de0 2024-09-21T07:01:30.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.028+0000 7fc375c25640 1 -- 172.21.15.63:0/1342086444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3700cdda0 con 0x7fc3700b9de0 2024-09-21T07:01:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.029+0000 7fc375c25640 1 -- 172.21.15.63:0/1342086444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37006ecf0 con 0x7fc3700b9de0 2024-09-21T07:01:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.030+0000 7fc357fff640 1 -- 172.21.15.63:0/1342086444 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc3680054d0 con 0x7fc3700b9de0 2024-09-21T07:01:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.031+0000 7fc357fff640 1 --2- 172.21.15.63:0/1342086444 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc35c078b90 0x7fc35c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.031+0000 7fc357fff640 1 -- 172.21.15.63:0/1342086444 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7fc36809a580 con 0x7fc3700b9de0 2024-09-21T07:01:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.031+0000 7fc36f7fe640 1 --2- 172.21.15.63:0/1342086444 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc35c078b90 0x7fc35c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.032+0000 7fc36f7fe640 1 --2- 172.21.15.63:0/1342086444 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc35c078b90 0x7fc35c07b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc360009c20 tx=0x7fc360005f30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:30.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.036+0000 7fc357fff640 1 -- 172.21.15.63:0/1342086444 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fc3680626a0 con 0x7fc3700b9de0 2024-09-21T07:01:30.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.224+0000 7fc375c25640 1 -- 172.21.15.63:0/1342086444 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fc37006f980 con 0x7fc3700b9de0 2024-09-21T07:01:30.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.227+0000 7fc357fff640 1 -- 172.21.15.63:0/1342086444 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7fc3680670d0 con 0x7fc3700b9de0 2024-09-21T07:01:30.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.230+0000 7fc375c25640 1 -- 172.21.15.63:0/1342086444 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc35c078b90 msgr2=0x7fc35c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:30.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.230+0000 7fc375c25640 1 --2- 172.21.15.63:0/1342086444 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc35c078b90 0x7fc35c07b0a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc360009c20 tx=0x7fc360005f30 comp rx=0 tx=0).stop 2024-09-21T07:01:30.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.230+0000 7fc375c25640 1 -- 172.21.15.63:0/1342086444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3700b9de0 msgr2=0x7fc37014d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:30.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.230+0000 7fc375c25640 1 --2- 172.21.15.63:0/1342086444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3700b9de0 0x7fc37014d0c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc37008e940 tx=0x7fc36800cb90 comp rx=0 tx=0).stop 2024-09-21T07:01:30.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.230+0000 7fc375c25640 1 -- 172.21.15.63:0/1342086444 shutdown_connections 2024-09-21T07:01:30.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.230+0000 7fc375c25640 1 --2- 172.21.15.63:0/1342086444 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc35c078b90 0x7fc35c07b0a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.230+0000 7fc375c25640 1 --2- 172.21.15.63:0/1342086444 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc3700b9de0 0x7fc37014d0c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.230+0000 7fc375c25640 1 --2- 172.21.15.63:0/1342086444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc37008c960 0x7fc370155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.230+0000 7fc375c25640 1 --2- 172.21.15.63:0/1342086444 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc37006e8e0 0x7fc3700b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.230+0000 7fc375c25640 1 -- 172.21.15.63:0/1342086444 >> 172.21.15.63:0/1342086444 conn(0x7fc3700d4580 msgr2=0x7fc3700d4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:30.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.230+0000 7fc375c25640 1 -- 172.21.15.63:0/1342086444 shutdown_connections 2024-09-21T07:01:30.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.230+0000 7fc375c25640 1 -- 172.21.15.63:0/1342086444 wait complete. 2024-09-21T07:01:30.243 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal' 2024-09-21T07:01:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.359+0000 7ff57492b640 1 -- 172.21.15.63:0/2142884860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5700b3b60 msgr2=0x7ff5700ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.359+0000 7ff57492b640 1 --2- 172.21.15.63:0/2142884860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5700b3b60 0x7ff5700ce440 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff568005fd0 tx=0x7ff56802a940 comp rx=0 tx=0).stop 2024-09-21T07:01:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.359+0000 7ff57492b640 1 -- 172.21.15.63:0/2142884860 shutdown_connections 2024-09-21T07:01:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.359+0000 7ff57492b640 1 --2- 172.21.15.63:0/2142884860 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5700b3b60 0x7ff5700ce440 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.359+0000 7ff57492b640 1 -- 172.21.15.63:0/2142884860 >> 172.21.15.63:0/2142884860 conn(0x7ff5700b3fb0 msgr2=0x7ff5700b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.359+0000 7ff57492b640 1 -- 172.21.15.63:0/2142884860 shutdown_connections 2024-09-21T07:01:30.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.359+0000 7ff57492b640 1 -- 172.21.15.63:0/2142884860 wait complete. 2024-09-21T07:01:30.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.361+0000 7ff57492b640 1 Processor -- start 2024-09-21T07:01:30.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.361+0000 7ff57492b640 1 -- start start 2024-09-21T07:01:30.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.362+0000 7ff57492b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5700b3750 0x7ff57015d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:30.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.362+0000 7ff57492b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5700b3b60 0x7ff570151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:30.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.362+0000 7ff57492b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff570154de0 0x7ff57015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:30.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.362+0000 7ff57492b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff570167cf0 con 0x7ff5700b3750 2024-09-21T07:01:30.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.362+0000 7ff57492b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff570167b70 con 0x7ff5700b3b60 2024-09-21T07:01:30.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.362+0000 7ff57492b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff570167e70 con 0x7ff570154de0 2024-09-21T07:01:30.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.362+0000 7ff56e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5700b3750 0x7ff57015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:30.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.362+0000 7ff56e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5700b3750 0x7ff57015d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42568/0 (socket says 172.21.15.63:42568) 2024-09-21T07:01:30.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.362+0000 7ff56e59c640 1 -- 172.21.15.63:0/1064768957 learned_addr learned my addr 172.21.15.63:0/1064768957 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:30.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.362+0000 7ff56ed9d640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff570154de0 0x7ff57015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:30.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.362+0000 7ff56dd9b640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5700b3b60 0x7ff570151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:30.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.363+0000 7ff56e59c640 1 -- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff570154de0 msgr2=0x7ff57015ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:30.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.363+0000 7ff56e59c640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff570154de0 0x7ff57015ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.363+0000 7ff56e59c640 1 -- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5700b3b60 msgr2=0x7ff570151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:30.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.363+0000 7ff56e59c640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5700b3b60 0x7ff570151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.363+0000 7ff56e59c640 1 -- 172.21.15.63:0/1064768957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57009c5f0 con 0x7ff5700b3750 2024-09-21T07:01:30.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.363+0000 7ff56e59c640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5700b3750 0x7ff57015d800 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff56000c400 tx=0x7ff56000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:30.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.363+0000 7ff55effd640 1 -- 172.21.15.63:0/1064768957 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560017070 con 0x7ff5700b3750 2024-09-21T07:01:30.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.363+0000 7ff57492b640 1 -- 172.21.15.63:0/1064768957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57009c8d0 con 0x7ff5700b3750 2024-09-21T07:01:30.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.363+0000 7ff55effd640 1 -- 172.21.15.63:0/1064768957 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5600053c0 con 0x7ff5700b3750 2024-09-21T07:01:30.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.363+0000 7ff55effd640 1 -- 172.21.15.63:0/1064768957 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff560003850 con 0x7ff5700b3750 2024-09-21T07:01:30.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.363+0000 7ff57492b640 1 -- 172.21.15.63:0/1064768957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57009f0d0 con 0x7ff5700b3750 2024-09-21T07:01:30.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.364+0000 7ff57492b640 1 -- 172.21.15.63:0/1064768957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff57009aa40 con 0x7ff5700b3750 2024-09-21T07:01:30.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.365+0000 7ff55effd640 1 -- 172.21.15.63:0/1064768957 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff56001a070 con 0x7ff5700b3750 2024-09-21T07:01:30.367 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.366+0000 7ff55effd640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff550078bc0 0x7ff55007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:30.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.366+0000 7ff55effd640 1 -- 172.21.15.63:0/1064768957 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7ff560099cf0 con 0x7ff5700b3750 2024-09-21T07:01:30.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.366+0000 7ff56dd9b640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff550078bc0 0x7ff55007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:30.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.367+0000 7ff56dd9b640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff550078bc0 0x7ff55007b0d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5701583b0 tx=0x7ff564009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:30.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.371+0000 7ff55effd640 1 -- 172.21.15.63:0/1064768957 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff56009e070 con 0x7ff5700b3750 2024-09-21T07:01:30.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.636+0000 7ff57492b640 1 -- 172.21.15.63:0/1064768957 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]} v 0) -- 0x7ff57006a130 con 0x7ff5700b3750 2024-09-21T07:01:30.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.894+0000 7ff55effd640 1 -- 172.21.15.63:0/1064768957 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_recovery_fs.TestFSRecovery.test_recover_fs_after_fsmap_removal"]}]=0 v87) ==== 159+0+0 (secure 0 0 0) 0x7ff560061e10 con 0x7ff5700b3750 2024-09-21T07:01:30.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.896+0000 7ff57492b640 1 -- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff550078bc0 msgr2=0x7ff55007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.896+0000 7ff57492b640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff550078bc0 0x7ff55007b0d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5701583b0 tx=0x7ff564009040 comp rx=0 tx=0).stop 2024-09-21T07:01:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.896+0000 7ff57492b640 1 -- 172.21.15.63:0/1064768957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5700b3750 msgr2=0x7ff57015d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.896+0000 7ff57492b640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5700b3750 0x7ff57015d800 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff56000c400 tx=0x7ff56000c8c0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.896+0000 7ff57492b640 1 -- 172.21.15.63:0/1064768957 shutdown_connections 2024-09-21T07:01:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.896+0000 7ff57492b640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff550078bc0 0x7ff55007b0d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.896+0000 7ff57492b640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff570154de0 0x7ff57015ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.896+0000 7ff57492b640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5700b3b60 0x7ff570151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.896+0000 7ff57492b640 1 --2- 172.21.15.63:0/1064768957 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5700b3750 0x7ff57015d800 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.896+0000 7ff57492b640 1 -- 172.21.15.63:0/1064768957 >> 172.21.15.63:0/1064768957 conn(0x7ff5700b3fb0 msgr2=0x7ff570071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.897+0000 7ff57492b640 1 -- 172.21.15.63:0/1064768957 shutdown_connections 2024-09-21T07:01:30.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:30.897+0000 7ff57492b640 1 -- 172.21.15.63:0/1064768957 wait complete. 2024-09-21T07:01:30.910 INFO:tasks.cephfs_test_runner:test_recover_fs_after_fsmap_removal (tasks.cephfs.test_recovery_fs.TestFSRecovery) ... ok 2024-09-21T07:01:30.910 INFO:tasks.cephfs_test_runner: 2024-09-21T07:01:30.910 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-21T07:01:30.910 INFO:tasks.cephfs_test_runner:Ran 1 test in 45.039s 2024-09-21T07:01:30.910 INFO:tasks.cephfs_test_runner: 2024-09-21T07:01:30.910 INFO:tasks.cephfs_test_runner:OK 2024-09-21T07:01:30.911 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-21T07:01:30.919 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T07:01:30.974 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T07:01:30.974 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:01:30.974 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:01:30.991 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17502 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:01:30.991 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-09-21T07:01:30.991 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:01:31.048 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17502 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-21T07:01:31.048 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T07:01:31.048 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:01:31.067 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1566 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:01:31.067 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-21T07:01:31.067 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T07:01:31.125 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056014,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1566 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497444k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-21T07:01:31.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:31.126 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-21T07:01:31.142 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-21T07:01:31.142 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T07:01:31.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:31.142 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-21T07:01:31.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:31.209 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T07:01:31.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:31.274 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-21T07:01:31.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:31.376 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-09-21T07:01:31.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:31.392 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-09-21T07:01:31.462 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2024-09-21T07:01:31.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:01:31.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:31.463 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-09-21T07:01:31.483 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-21T07:01:31.483 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-21T07:01:31.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:31.483 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-21T07:01:31.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:31.553 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T07:01:31.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:31.621 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2024-09-21T07:01:31.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:31.726 DEBUG:teuthology.orchestra.run.smithi071:> ip netns list 2024-09-21T07:01:31.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T07:01:31.743 DEBUG:teuthology.orchestra.run.smithi071:> sudo ip link delete ceph-brx 2024-09-21T07:01:31.812 INFO:teuthology.orchestra.run.smithi071.stderr:Cannot find device "ceph-brx" 2024-09-21T07:01:31.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:01:31.813 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T07:01:31.821 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T07:01:31.822 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:01:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.939+0000 7fb968ef4640 1 -- 172.21.15.63:0/2992614801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96406f020 msgr2=0x7fb96415f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.939+0000 7fb968ef4640 1 --2- 172.21.15.63:0/2992614801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96406f020 0x7fb96415f230 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb964072a70 tx=0x7fb94c02a5f0 comp rx=0 tx=0).stop 2024-09-21T07:01:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.939+0000 7fb968ef4640 1 -- 172.21.15.63:0/2992614801 shutdown_connections 2024-09-21T07:01:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.939+0000 7fb968ef4640 1 --2- 172.21.15.63:0/2992614801 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb96415f770 0x7fb96415fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:31.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.939+0000 7fb968ef4640 1 --2- 172.21.15.63:0/2992614801 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96406f020 0x7fb96415f230 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.939+0000 7fb968ef4640 1 --2- 172.21.15.63:0/2992614801 >> v2:172.21.15.71:3300/0 conn(0x7fb964070830 0x7fb964155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.939+0000 7fb968ef4640 1 -- 172.21.15.63:0/2992614801 >> 172.21.15.63:0/2992614801 conn(0x7fb96406d3e0 msgr2=0x7fb9640b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.939+0000 7fb968ef4640 1 -- 172.21.15.63:0/2992614801 shutdown_connections 2024-09-21T07:01:31.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.939+0000 7fb968ef4640 1 -- 172.21.15.63:0/2992614801 wait complete. 2024-09-21T07:01:31.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.941+0000 7fb968ef4640 1 Processor -- start 2024-09-21T07:01:31.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.941+0000 7fb968ef4640 1 -- start start 2024-09-21T07:01:31.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.942+0000 7fb968ef4640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb96406f020 0x7fb964155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:31.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.942+0000 7fb968ef4640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb964070830 0x7fb964074270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:31.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.942+0000 7fb968ef4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96415f770 0x7fb9640747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:31.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.942+0000 7fb968ef4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb96415c220 con 0x7fb96415f770 2024-09-21T07:01:31.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.942+0000 7fb968ef4640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb96415c0a0 con 0x7fb964070830 2024-09-21T07:01:31.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.942+0000 7fb968ef4640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb96415c3a0 con 0x7fb96406f020 2024-09-21T07:01:31.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb962d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96415f770 0x7fb9640747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb962d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96415f770 0x7fb9640747b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42586/0 (socket says 172.21.15.63:42586) 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb96259c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb96406f020 0x7fb964155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb962d9d640 1 -- 172.21.15.63:0/1296160358 learned_addr learned my addr 172.21.15.63:0/1296160358 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb961d9b640 1 --2- 172.21.15.63:0/1296160358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb964070830 0x7fb964074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb962d9d640 1 -- 172.21.15.63:0/1296160358 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb96406f020 msgr2=0x7fb964155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb962d9d640 1 --2- 172.21.15.63:0/1296160358 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb96406f020 0x7fb964155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb962d9d640 1 -- 172.21.15.63:0/1296160358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb964070830 msgr2=0x7fb964074270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb962d9d640 1 --2- 172.21.15.63:0/1296160358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb964070830 0x7fb964074270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb962d9d640 1 -- 172.21.15.63:0/1296160358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9640c5880 con 0x7fb96415f770 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb962d9d640 1 --2- 172.21.15.63:0/1296160358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96415f770 0x7fb9640747b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00c950 tx=0x7fb95c00ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb95affd640 1 -- 172.21.15.63:0/1296160358 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c007b50 con 0x7fb96415f770 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb95affd640 1 -- 172.21.15.63:0/1296160358 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb95c007de0 con 0x7fb96415f770 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb968ef4640 1 -- 172.21.15.63:0/1296160358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9640c5b60 con 0x7fb96415f770 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb95affd640 1 -- 172.21.15.63:0/1296160358 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c005280 con 0x7fb96415f770 2024-09-21T07:01:31.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.943+0000 7fb968ef4640 1 -- 172.21.15.63:0/1296160358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9640c6120 con 0x7fb96415f770 2024-09-21T07:01:31.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.944+0000 7fb968ef4640 1 -- 172.21.15.63:0/1296160358 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb964076850 con 0x7fb96415f770 2024-09-21T07:01:31.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.945+0000 7fb95affd640 1 -- 172.21.15.63:0/1296160358 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb95c005420 con 0x7fb96415f770 2024-09-21T07:01:31.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.946+0000 7fb95affd640 1 --2- 172.21.15.63:0/1296160358 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb944078bc0 0x7fb94407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:31.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.946+0000 7fb95affd640 1 -- 172.21.15.63:0/1296160358 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7fb95c09ade0 con 0x7fb96415f770 2024-09-21T07:01:31.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.946+0000 7fb96259c640 1 --2- 172.21.15.63:0/1296160358 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb944078bc0 0x7fb94407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:31.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.946+0000 7fb96259c640 1 --2- 172.21.15.63:0/1296160358 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb944078bc0 0x7fb94407b0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb954005fd0 tx=0x7fb95400a4d0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:31.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:31.950+0000 7fb95affd640 1 -- 172.21.15.63:0/1296160358 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb964076850 con 0x7fb96415f770 2024-09-21T07:01:32.135 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.134+0000 7fb968ef4640 1 -- 172.21.15.63:0/1296160358 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb964071960 con 0x7fb944078bc0 2024-09-21T07:01:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.135+0000 7fb95affd640 1 -- 172.21.15.63:0/1296160358 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13466 (secure 0 0 0) 0x7fb964071960 con 0x7fb944078bc0 2024-09-21T07:01:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:01:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.136+0000 7fb968ef4640 1 -- 172.21.15.63:0/1296160358 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb944078bc0 msgr2=0x7fb94407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.136+0000 7fb968ef4640 1 --2- 172.21.15.63:0/1296160358 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb944078bc0 0x7fb94407b0d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb954005fd0 tx=0x7fb95400a4d0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.136+0000 7fb968ef4640 1 -- 172.21.15.63:0/1296160358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96415f770 msgr2=0x7fb9640747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.136+0000 7fb968ef4640 1 --2- 172.21.15.63:0/1296160358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96415f770 0x7fb9640747b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00c950 tx=0x7fb95c00ce10 comp rx=0 tx=0).stop 2024-09-21T07:01:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.137+0000 7fb968ef4640 1 -- 172.21.15.63:0/1296160358 shutdown_connections 2024-09-21T07:01:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.137+0000 7fb968ef4640 1 --2- 172.21.15.63:0/1296160358 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb944078bc0 0x7fb94407b0d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.137+0000 7fb968ef4640 1 --2- 172.21.15.63:0/1296160358 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb96415f770 0x7fb9640747b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.137+0000 7fb968ef4640 1 --2- 172.21.15.63:0/1296160358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb964070830 0x7fb964074270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.137+0000 7fb968ef4640 1 --2- 172.21.15.63:0/1296160358 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb96406f020 0x7fb964155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.137+0000 7fb968ef4640 1 -- 172.21.15.63:0/1296160358 >> 172.21.15.63:0/1296160358 conn(0x7fb96406d3e0 msgr2=0x7fb96415e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.137+0000 7fb968ef4640 1 -- 172.21.15.63:0/1296160358 shutdown_connections 2024-09-21T07:01:32.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.137+0000 7fb968ef4640 1 -- 172.21.15.63:0/1296160358 wait complete. 2024-09-21T07:01:32.149 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-09-21T07:01:30.614595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":220684,"kb_used_data":4448,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754036,"statfs":{"total":773094113280,"available":772868132864,"internally_reserved":0,"allocated":4554752,"data_stored":2507886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7201,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-19,"num_read_kb":-23,"num_write":-51,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001768"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":138,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-21T07:01:29.112601+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:01:29.112601+0000","last_peered":"2024-09-21T07:01:29.112601+0000","last_clean":"2024-09-21T07:01:29.112601+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:01:29.112601+0000","last_undegraded":"2024-09-21T07:01:29.112601+0000","last_fullsized":"2024-09-21T07:01:29.112601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":170549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":164898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1011712,"data_stored":755266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":417792,"data_stored":164898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":755266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":164899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":167212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:01:32.150 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:01:32.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.264+0000 7f4c33e3f640 1 -- 172.21.15.63:0/1731876 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2c0b52a0 msgr2=0x7f4c2c0b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.264+0000 7f4c33e3f640 1 --2- 172.21.15.63:0/1731876 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2c0b52a0 0x7f4c2c0b56b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009860 tx=0x7f4c1c02a4a0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.265+0000 7f4c33e3f640 1 -- 172.21.15.63:0/1731876 shutdown_connections 2024-09-21T07:01:32.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.265+0000 7f4c33e3f640 1 --2- 172.21.15.63:0/1731876 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2c0b52a0 0x7f4c2c0b56b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.265+0000 7f4c33e3f640 1 -- 172.21.15.63:0/1731876 >> 172.21.15.63:0/1731876 conn(0x7f4c2c0ceed0 msgr2=0x7f4c2c0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:32.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.265+0000 7f4c33e3f640 1 -- 172.21.15.63:0/1731876 shutdown_connections 2024-09-21T07:01:32.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.265+0000 7f4c33e3f640 1 -- 172.21.15.63:0/1731876 wait complete. 2024-09-21T07:01:32.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.267+0000 7f4c33e3f640 1 Processor -- start 2024-09-21T07:01:32.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.267+0000 7f4c33e3f640 1 -- start start 2024-09-21T07:01:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.268+0000 7f4c33e3f640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c2c0b52a0 0x7f4c2c0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.268+0000 7f4c33e3f640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2c0cd0b0 0x7f4c2c14d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.268+0000 7f4c33e3f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c2c0d0350 0x7f4c2c0c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.268+0000 7f4c33e3f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c0d0760 con 0x7f4c2c0d0350 2024-09-21T07:01:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.268+0000 7f4c33e3f640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c0d1400 con 0x7f4c2c0b52a0 2024-09-21T07:01:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.268+0000 7f4c33e3f640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2c0b5bf0 con 0x7f4c2c0cd0b0 2024-09-21T07:01:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.268+0000 7f4c323dc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c2c0d0350 0x7f4c2c0c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.268+0000 7f4c323dc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c2c0d0350 0x7f4c2c0c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42588/0 (socket says 172.21.15.63:42588) 2024-09-21T07:01:32.271 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.268+0000 7f4c323dc640 1 -- 172.21.15.63:0/2602258849 learned_addr learned my addr 172.21.15.63:0/2602258849 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:32.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.268+0000 7f4c313da640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2c0cd0b0 0x7f4c2c14d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:32.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.268+0000 7f4c31bdb640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c2c0b52a0 0x7f4c2c0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:32.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.268+0000 7f4c323dc640 1 -- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2c0cd0b0 msgr2=0x7f4c2c14d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.268+0000 7f4c323dc640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2c0cd0b0 0x7f4c2c14d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.269+0000 7f4c323dc640 1 -- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c2c0b52a0 msgr2=0x7f4c2c0cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.269+0000 7f4c323dc640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c2c0b52a0 0x7f4c2c0cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.269+0000 7f4c323dc640 1 -- 172.21.15.63:0/2602258849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2c0cb6e0 con 0x7f4c2c0d0350 2024-09-21T07:01:32.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.269+0000 7f4c323dc640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c2c0d0350 0x7f4c2c0c6a00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400c7a0 tx=0x7f4c2400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:32.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.269+0000 7f4c227fc640 1 -- 172.21.15.63:0/2602258849 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c24017070 con 0x7f4c2c0d0350 2024-09-21T07:01:32.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.269+0000 7f4c33e3f640 1 -- 172.21.15.63:0/2602258849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c2c0cb9c0 con 0x7f4c2c0d0350 2024-09-21T07:01:32.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.269+0000 7f4c227fc640 1 -- 172.21.15.63:0/2602258849 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c24005070 con 0x7f4c2c0d0350 2024-09-21T07:01:32.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.269+0000 7f4c227fc640 1 -- 172.21.15.63:0/2602258849 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c240054c0 con 0x7f4c2c0d0350 2024-09-21T07:01:32.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.269+0000 7f4c33e3f640 1 -- 172.21.15.63:0/2602258849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c2c0c6f40 con 0x7f4c2c0d0350 2024-09-21T07:01:32.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.270+0000 7f4c33e3f640 1 -- 172.21.15.63:0/2602258849 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c2c0cb450 con 0x7f4c2c0d0350 2024-09-21T07:01:32.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.271+0000 7f4c227fc640 1 -- 172.21.15.63:0/2602258849 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c2401a070 con 0x7f4c2c0d0350 2024-09-21T07:01:32.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.271+0000 7f4c227fc640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4c10078bc0 0x7f4c1007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:32.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.271+0000 7f4c227fc640 1 -- 172.21.15.63:0/2602258849 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f4c2409a0e0 con 0x7f4c2c0d0350 2024-09-21T07:01:32.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.272+0000 7f4c31bdb640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4c10078bc0 0x7f4c1007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:32.274 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.272+0000 7f4c31bdb640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4c10078bc0 0x7f4c1007b0d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4c28007fd0 tx=0x7f4c28009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:32.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.276+0000 7f4c227fc640 1 -- 172.21.15.63:0/2602258849 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f4c24062180 con 0x7f4c2c0d0350 2024-09-21T07:01:32.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.457+0000 7f4c33e3f640 1 -- 172.21.15.63:0/2602258849 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c2c0b75e0 con 0x7f4c10078bc0 2024-09-21T07:01:32.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.459+0000 7f4c227fc640 1 -- 172.21.15.63:0/2602258849 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13466 (secure 0 0 0) 0x7f4c2c0b75e0 con 0x7f4c10078bc0 2024-09-21T07:01:32.461 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:32.461 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:01:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.461+0000 7f4c33e3f640 1 -- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4c10078bc0 msgr2=0x7f4c1007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.461+0000 7f4c33e3f640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4c10078bc0 0x7f4c1007b0d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4c28007fd0 tx=0x7f4c28009040 comp rx=0 tx=0).stop 2024-09-21T07:01:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.461+0000 7f4c33e3f640 1 -- 172.21.15.63:0/2602258849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c2c0d0350 msgr2=0x7f4c2c0c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.461+0000 7f4c33e3f640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c2c0d0350 0x7f4c2c0c6a00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400c7a0 tx=0x7f4c2400cc60 comp rx=0 tx=0).stop 2024-09-21T07:01:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.461+0000 7f4c33e3f640 1 -- 172.21.15.63:0/2602258849 shutdown_connections 2024-09-21T07:01:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.461+0000 7f4c33e3f640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f4c10078bc0 0x7f4c1007b0d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.461+0000 7f4c33e3f640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c2c0d0350 0x7f4c2c0c6a00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.461+0000 7f4c33e3f640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f4c2c0cd0b0 0x7f4c2c14d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.461+0000 7f4c33e3f640 1 --2- 172.21.15.63:0/2602258849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c2c0b52a0 0x7f4c2c0cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.461+0000 7f4c33e3f640 1 -- 172.21.15.63:0/2602258849 >> 172.21.15.63:0/2602258849 conn(0x7f4c2c0ceed0 msgr2=0x7f4c2c072640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.461+0000 7f4c33e3f640 1 -- 172.21.15.63:0/2602258849 shutdown_connections 2024-09-21T07:01:32.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.461+0000 7f4c33e3f640 1 -- 172.21.15.63:0/2602258849 wait complete. 2024-09-21T07:01:32.473 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-09-21T07:01:30.614595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":220684,"kb_used_data":4448,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754036,"statfs":{"total":773094113280,"available":772868132864,"internally_reserved":0,"allocated":4554752,"data_stored":2507886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7201,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-19,"num_read_kb":-23,"num_write":-51,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001768"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":138,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-21T07:01:29.112601+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:01:29.112601+0000","last_peered":"2024-09-21T07:01:29.112601+0000","last_clean":"2024-09-21T07:01:29.112601+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:01:29.112601+0000","last_undegraded":"2024-09-21T07:01:29.112601+0000","last_fullsized":"2024-09-21T07:01:29.112601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":170549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":164898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1011712,"data_stored":755266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":417792,"data_stored":164898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":755266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":164899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":167212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:01:32.474 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T07:01:32.474 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:01:32.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.588+0000 7fdbc9484640 1 -- 172.21.15.63:0/881863879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40b9aa0 msgr2=0x7fdbc40d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.588+0000 7fdbc9484640 1 --2- 172.21.15.63:0/881863879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40b9aa0 0x7fdbc40d0bf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdbc406db40 tx=0x7fdbac02a4d0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.588+0000 7fdbc9484640 1 -- 172.21.15.63:0/881863879 shutdown_connections 2024-09-21T07:01:32.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.588+0000 7fdbc9484640 1 --2- 172.21.15.63:0/881863879 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40b9aa0 0x7fdbc40d0bf0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.588+0000 7fdbc9484640 1 --2- 172.21.15.63:0/881863879 >> v2:172.21.15.71:3300/0 conn(0x7fdbc40b3aa0 0x7fdbc40d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.588+0000 7fdbc9484640 1 -- 172.21.15.63:0/881863879 >> 172.21.15.63:0/881863879 conn(0x7fdbc40d45e0 msgr2=0x7fdbc40d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:32.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.588+0000 7fdbc9484640 1 -- 172.21.15.63:0/881863879 shutdown_connections 2024-09-21T07:01:32.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.588+0000 7fdbc9484640 1 -- 172.21.15.63:0/881863879 wait complete. 2024-09-21T07:01:32.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.590+0000 7fdbc9484640 1 Processor -- start 2024-09-21T07:01:32.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.590+0000 7fdbc9484640 1 -- start start 2024-09-21T07:01:32.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.591+0000 7fdbc9484640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc408c960 0x7fdbc414de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:32.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.591+0000 7fdbc9484640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdbc40b3aa0 0x7fdbc40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.591+0000 7fdbc9484640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40b9aa0 0x7fdbc40cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.591+0000 7fdbc9484640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc406f1c0 con 0x7fdbc40b9aa0 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.591+0000 7fdbc9484640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc406f040 con 0x7fdbc408c960 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.591+0000 7fdbc9484640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc406f340 con 0x7fdbc40b3aa0 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc2ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc408c960 0x7fdbc414de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40b9aa0 0x7fdbc40cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc2ffd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc408c960 0x7fdbc414de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:55000/0 (socket says 172.21.15.63:55000) 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc2ffd640 1 -- 172.21.15.63:0/1911958086 learned_addr learned my addr 172.21.15.63:0/1911958086 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc27fc640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdbc40b3aa0 0x7fdbc40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc37fe640 1 -- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdbc40b3aa0 msgr2=0x7fdbc40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc37fe640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdbc40b3aa0 0x7fdbc40ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc37fe640 1 -- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc408c960 msgr2=0x7fdbc414de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc37fe640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc408c960 0x7fdbc414de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc37fe640 1 -- 172.21.15.63:0/1911958086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc40cacd0 con 0x7fdbc40b9aa0 2024-09-21T07:01:32.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc2ffd640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc408c960 0x7fdbc414de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:32.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc27fc640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdbc40b3aa0 0x7fdbc40ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:32.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc37fe640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40b9aa0 0x7fdbc40cd000 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400be30 tx=0x7fdbb400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:32.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbbb7fe640 1 -- 172.21.15.63:0/1911958086 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4019070 con 0x7fdbc40b9aa0 2024-09-21T07:01:32.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbbb7fe640 1 -- 172.21.15.63:0/1911958086 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbb4014440 con 0x7fdbc40b9aa0 2024-09-21T07:01:32.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbbb7fe640 1 -- 172.21.15.63:0/1911958086 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4014890 con 0x7fdbc40b9aa0 2024-09-21T07:01:32.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc9484640 1 -- 172.21.15.63:0/1911958086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc40b5bb0 con 0x7fdbc40b9aa0 2024-09-21T07:01:32.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.592+0000 7fdbc9484640 1 -- 172.21.15.63:0/1911958086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc40b6170 con 0x7fdbc40b9aa0 2024-09-21T07:01:32.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.594+0000 7fdbc9484640 1 -- 172.21.15.63:0/1911958086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc40d1340 con 0x7fdbc40b9aa0 2024-09-21T07:01:32.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.594+0000 7fdbbb7fe640 1 -- 172.21.15.63:0/1911958086 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbb401c070 con 0x7fdbc40b9aa0 2024-09-21T07:01:32.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.595+0000 7fdbbb7fe640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdba4078b90 0x7fdba407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:32.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.595+0000 7fdbbb7fe640 1 -- 172.21.15.63:0/1911958086 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7fdbb409a850 con 0x7fdbc40b9aa0 2024-09-21T07:01:32.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.595+0000 7fdbc2ffd640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdba4078b90 0x7fdba407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:32.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.595+0000 7fdbc2ffd640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdba4078b90 0x7fdba407b0a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc005860 tx=0x7fdbbc00b390 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:32.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.599+0000 7fdbbb7fe640 1 -- 172.21.15.63:0/1911958086 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fdbb4062970 con 0x7fdbc40b9aa0 2024-09-21T07:01:32.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.782+0000 7fdbc9484640 1 -- 172.21.15.63:0/1911958086 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdbc40cafb0 con 0x7fdba4078b90 2024-09-21T07:01:32.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.783+0000 7fdbbb7fe640 1 -- 172.21.15.63:0/1911958086 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13478 (secure 0 0 0) 0x7fdbc40cafb0 con 0x7fdba4078b90 2024-09-21T07:01:32.785 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:32.785 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:01:32.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.785+0000 7fdbc9484640 1 -- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdba4078b90 msgr2=0x7fdba407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.785+0000 7fdbc9484640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdba4078b90 0x7fdba407b0a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc005860 tx=0x7fdbbc00b390 comp rx=0 tx=0).stop 2024-09-21T07:01:32.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.785+0000 7fdbc9484640 1 -- 172.21.15.63:0/1911958086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40b9aa0 msgr2=0x7fdbc40cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.785+0000 7fdbc9484640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40b9aa0 0x7fdbc40cd000 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400be30 tx=0x7fdbb400bf20 comp rx=0 tx=0).stop 2024-09-21T07:01:32.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.785+0000 7fdbc9484640 1 -- 172.21.15.63:0/1911958086 shutdown_connections 2024-09-21T07:01:32.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.785+0000 7fdbc9484640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdba4078b90 0x7fdba407b0a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.785+0000 7fdbc9484640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdbc40b9aa0 0x7fdbc40cd000 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.785+0000 7fdbc9484640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdbc40b3aa0 0x7fdbc40ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.785+0000 7fdbc9484640 1 --2- 172.21.15.63:0/1911958086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdbc408c960 0x7fdbc414de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.785+0000 7fdbc9484640 1 -- 172.21.15.63:0/1911958086 >> 172.21.15.63:0/1911958086 conn(0x7fdbc40d45e0 msgr2=0x7fdbc406df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:32.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.785+0000 7fdbc9484640 1 -- 172.21.15.63:0/1911958086 shutdown_connections 2024-09-21T07:01:32.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.785+0000 7fdbc9484640 1 -- 172.21.15.63:0/1911958086 wait complete. 2024-09-21T07:01:32.798 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-09-21T07:01:32.614988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":220700,"kb_used_data":4460,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754020,"statfs":{"total":773094113280,"available":772868116480,"internally_reserved":0,"allocated":4567040,"data_stored":2511223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9180,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-81,"num_read_kb":-88,"num_write":-62,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001693"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":138,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-21T07:01:29.112601+0000","last_change":"2024-09-21T07:00:12.589641+0000","last_active":"2024-09-21T07:01:29.112601+0000","last_peered":"2024-09-21T07:01:29.112601+0000","last_clean":"2024-09-21T07:01:29.112601+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:01:29.112601+0000","last_undegraded":"2024-09-21T07:01:29.112601+0000","last_fullsized":"2024-09-21T07:01:29.112601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T07:00:11.211927+0000","last_clean_scrub_stamp":"2024-09-21T07:00:11.211927+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:10.921245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509460,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":170549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":164898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1011712,"data_stored":755266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":417792,"data_stored":164898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1011712,"data_stored":755266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":164899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":170549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:01:32.799 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T07:01:32.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.914+0000 7ff10ff20640 1 -- 172.21.15.63:0/219224418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1080b9aa0 msgr2=0x7ff1080d0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.914+0000 7ff10ff20640 1 --2- 172.21.15.63:0/219224418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1080b9aa0 0x7ff1080d0bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff104005fd0 tx=0x7ff10402a540 comp rx=0 tx=0).stop 2024-09-21T07:01:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.915+0000 7ff10ff20640 1 -- 172.21.15.63:0/219224418 shutdown_connections 2024-09-21T07:01:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.915+0000 7ff10ff20640 1 --2- 172.21.15.63:0/219224418 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1080b9aa0 0x7ff1080d0bf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.915+0000 7ff10ff20640 1 -- 172.21.15.63:0/219224418 >> 172.21.15.63:0/219224418 conn(0x7ff1080d45e0 msgr2=0x7ff1080d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.915+0000 7ff10ff20640 1 -- 172.21.15.63:0/219224418 shutdown_connections 2024-09-21T07:01:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.915+0000 7ff10ff20640 1 -- 172.21.15.63:0/219224418 wait complete. 2024-09-21T07:01:32.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.916+0000 7ff10ff20640 1 Processor -- start 2024-09-21T07:01:32.918 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.916+0000 7ff10ff20640 1 -- start start 2024-09-21T07:01:32.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10ff20640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff10808c960 0x7ff108156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:32.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10ff20640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1080b3aa0 0x7ff108161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:32.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10ff20640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080b9aa0 0x7ff1080cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:32.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10ff20640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff10806f3d0 con 0x7ff1080b3aa0 2024-09-21T07:01:32.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10ff20640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff10806f250 con 0x7ff1080b9aa0 2024-09-21T07:01:32.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10ff20640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7ff1080d1130 con 0x7ff10808c960 2024-09-21T07:01:32.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10d4bb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1080b3aa0 0x7ff108161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:32.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10d4bb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1080b3aa0 0x7ff108161ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42612/0 (socket says 172.21.15.63:42612) 2024-09-21T07:01:32.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10d4bb640 1 -- 172.21.15.63:0/992731674 learned_addr learned my addr 172.21.15.63:0/992731674 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:32.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10dcbc640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff10808c960 0x7ff108156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:32.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10e4bd640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080b9aa0 0x7ff1080cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:32.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10d4bb640 1 -- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff10808c960 msgr2=0x7ff108156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10d4bb640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff10808c960 0x7ff108156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10d4bb640 1 -- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080b9aa0 msgr2=0x7ff1080cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:32.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10d4bb640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080b9aa0 0x7ff1080cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:32.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10d4bb640 1 -- 172.21.15.63:0/992731674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff108160c00 con 0x7ff1080b3aa0 2024-09-21T07:01:32.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10e4bd640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080b9aa0 0x7ff1080cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:32.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.918+0000 7ff10d4bb640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1080b3aa0 0x7ff108161ca0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff104034040 tx=0x7ff1040039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:32.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.919+0000 7ff0fa7fc640 1 -- 172.21.15.63:0/992731674 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10403e030 con 0x7ff1080b3aa0 2024-09-21T07:01:32.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.919+0000 7ff0fa7fc640 1 -- 172.21.15.63:0/992731674 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1040047a0 con 0x7ff1080b3aa0 2024-09-21T07:01:32.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.919+0000 7ff10ff20640 1 -- 172.21.15.63:0/992731674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff108160ee0 con 0x7ff1080b3aa0 2024-09-21T07:01:32.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.919+0000 7ff0fa7fc640 1 -- 172.21.15.63:0/992731674 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff104035040 con 0x7ff1080b3aa0 2024-09-21T07:01:32.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.919+0000 7ff10ff20640 1 -- 172.21.15.63:0/992731674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1081614a0 con 0x7ff1080b3aa0 2024-09-21T07:01:32.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.920+0000 7ff10ff20640 1 -- 172.21.15.63:0/992731674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1080d0bf0 con 0x7ff1080b3aa0 2024-09-21T07:01:32.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.920+0000 7ff0fa7fc640 1 -- 172.21.15.63:0/992731674 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff104041030 con 0x7ff1080b3aa0 2024-09-21T07:01:32.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.921+0000 7ff0fa7fc640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff0ec078bc0 0x7ff0ec07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:32.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.921+0000 7ff0fa7fc640 1 -- 172.21.15.63:0/992731674 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7ff1040bb2e0 con 0x7ff1080b3aa0 2024-09-21T07:01:32.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.921+0000 7ff10dcbc640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff0ec078bc0 0x7ff0ec07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:32.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.922+0000 7ff10dcbc640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff0ec078bc0 0x7ff0ec07b0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc001710 tx=0x7ff0fc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:32.927 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:32.925+0000 7ff0fa7fc640 1 -- 172.21.15.63:0/992731674 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7ff104083370 con 0x7ff1080b3aa0 2024-09-21T07:01:33.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.112+0000 7ff10ff20640 1 -- 172.21.15.63:0/992731674 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1080b3050 con 0x7ff1080b3aa0 2024-09-21T07:01:33.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.113+0000 7ff0fa7fc640 1 -- 172.21.15.63:0/992731674 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+13114 (secure 0 0 0) 0x7ff104087da0 con 0x7ff1080b3aa0 2024-09-21T07:01:33.115 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:33.115 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":38,"fsid":"2c317557-147d-48e9-8f3c-bb88131d3e37","created":"2024-09-21T06:59:56.215713+0000","modified":"2024-09-21T07:01:29.880595+0000","last_up_change":"2024-09-21T07:00:09.844091+0000","last_in_change":"2024-09-21T06:59:59.826223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T07:00:10.613861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b840b5c-68b1-49fe-8a51-63ae216acff4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6801","nonce":1037303619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6803","nonce":1037303619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6807","nonce":1037303619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":1037303619},{"type":"v1","addr":"172.21.15.63:6805","nonce":1037303619}]},"public_addr":"172.21.15.63:6801/1037303619","cluster_addr":"172.21.15.63:6803/1037303619","heartbeat_back_addr":"172.21.15.63:6807/1037303619","heartbeat_front_addr":"172.21.15.63:6805/1037303619","state":["exists","up"]},{"osd":1,"uuid":"3357f178-f274-4168-b56e-cbb55bfcb183","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6809","nonce":2756858470}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6811","nonce":2756858470}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6815","nonce":2756858470}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":2756858470},{"type":"v1","addr":"172.21.15.63:6813","nonce":2756858470}]},"public_addr":"172.21.15.63:6809/2756858470","cluster_addr":"172.21.15.63:6811/2756858470","heartbeat_back_addr":"172.21.15.63:6815/2756858470","heartbeat_front_addr":"172.21.15.63:6813/2756858470","state":["exists","up"]},{"osd":2,"uuid":"50da4810-f26a-476b-b74c-d4c9a84ddb20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6823","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6825","nonce":115139768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6827","nonce":115139768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6831","nonce":115139768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":115139768},{"type":"v1","addr":"172.21.15.63:6829","nonce":115139768}]},"public_addr":"172.21.15.63:6825/115139768","cluster_addr":"172.21.15.63:6827/115139768","heartbeat_back_addr":"172.21.15.63:6831/115139768","heartbeat_front_addr":"172.21.15.63:6829/115139768","state":["exists","up"]},{"osd":3,"uuid":"b5628000-3108-43fb-aa68-6b7d36a6a03f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6817","nonce":1900864594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6819","nonce":1900864594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6824","nonce":1900864594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1900864594},{"type":"v1","addr":"172.21.15.63:6821","nonce":1900864594}]},"public_addr":"172.21.15.63:6817/1900864594","cluster_addr":"172.21.15.63:6819/1900864594","heartbeat_back_addr":"172.21.15.63:6824/1900864594","heartbeat_front_addr":"172.21.15.63:6821/1900864594","state":["exists","up"]},{"osd":4,"uuid":"83b75617-6b8d-4f35-8aac-12c1dcc35b16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6803","nonce":3275296788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6805","nonce":3275296788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6809","nonce":3275296788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":3275296788},{"type":"v1","addr":"172.21.15.71:6807","nonce":3275296788}]},"public_addr":"172.21.15.71:6803/3275296788","cluster_addr":"172.21.15.71:6805/3275296788","heartbeat_back_addr":"172.21.15.71:6809/3275296788","heartbeat_front_addr":"172.21.15.71:6807/3275296788","state":["exists","up"]},{"osd":5,"uuid":"faef8d99-1065-4829-b459-3777c0945df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6819","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6820","nonce":3896443315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6825","nonce":3896443315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6831","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6833","nonce":3896443315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6827","nonce":3896443315},{"type":"v1","addr":"172.21.15.71:6829","nonce":3896443315}]},"public_addr":"172.21.15.71:6820/3896443315","cluster_addr":"172.21.15.71:6825/3896443315","heartbeat_back_addr":"172.21.15.71:6833/3896443315","heartbeat_front_addr":"172.21.15.71:6829/3896443315","state":["exists","up"]},{"osd":6,"uuid":"c533fc91-d14a-4378-9ff3-600db359e5a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6811","nonce":3022228131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6813","nonce":3022228131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6817","nonce":3022228131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":3022228131},{"type":"v1","addr":"172.21.15.71:6815","nonce":3022228131}]},"public_addr":"172.21.15.71:6811/3022228131","cluster_addr":"172.21.15.71:6813/3022228131","heartbeat_back_addr":"172.21.15.71:6817/3022228131","heartbeat_front_addr":"172.21.15.71:6815/3022228131","state":["exists","up"]},{"osd":7,"uuid":"a29980ab-aedd-464d-ac8f-bc73a58db089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6821","nonce":829212065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6823","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6824","nonce":829212065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6832","nonce":829212065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":829212065},{"type":"v1","addr":"172.21.15.71:6828","nonce":829212065}]},"public_addr":"172.21.15.71:6821/829212065","cluster_addr":"172.21.15.71:6824/829212065","heartbeat_back_addr":"172.21.15.71:6832/829212065","heartbeat_front_addr":"172.21.15.71:6828/829212065","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.463291+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.695088+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.349268+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.743305+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.013543+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.109364+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.419008+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T07:00:06.666414+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.63:6833/2711820189":"2024-09-22T07:01:26.689002+0000","172.21.15.63:6835/2711820189":"2024-09-22T07:01:26.689002+0000","172.21.15.63:6835/3748950985":"2024-09-22T07:01:15.789578+0000","172.21.15.63:6833/3748950985":"2024-09-22T07:01:15.789578+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T07:01:33.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.115+0000 7ff10ff20640 1 -- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff0ec078bc0 msgr2=0x7ff0ec07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:33.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.115+0000 7ff10ff20640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff0ec078bc0 0x7ff0ec07b0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc001710 tx=0x7ff0fc009040 comp rx=0 tx=0).stop 2024-09-21T07:01:33.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.116+0000 7ff10ff20640 1 -- 172.21.15.63:0/992731674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1080b3aa0 msgr2=0x7ff108161ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:33.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.116+0000 7ff10ff20640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1080b3aa0 0x7ff108161ca0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff104034040 tx=0x7ff1040039e0 comp rx=0 tx=0).stop 2024-09-21T07:01:33.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.116+0000 7ff10ff20640 1 -- 172.21.15.63:0/992731674 shutdown_connections 2024-09-21T07:01:33.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.116+0000 7ff10ff20640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7ff0ec078bc0 0x7ff0ec07b0d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:33.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.116+0000 7ff10ff20640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1080b9aa0 0x7ff1080cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:33.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.116+0000 7ff10ff20640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1080b3aa0 0x7ff108161ca0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:33.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.116+0000 7ff10ff20640 1 --2- 172.21.15.63:0/992731674 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7ff10808c960 0x7ff108156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:33.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.116+0000 7ff10ff20640 1 -- 172.21.15.63:0/992731674 >> 172.21.15.63:0/992731674 conn(0x7ff1080d45e0 msgr2=0x7ff108075c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:33.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.116+0000 7ff10ff20640 1 -- 172.21.15.63:0/992731674 shutdown_connections 2024-09-21T07:01:33.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:33.116+0000 7ff10ff20640 1 -- 172.21.15.63:0/992731674 wait complete. 2024-09-21T07:01:34.130 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T07:01:34.130 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:01:34.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.262+0000 7f23a5120640 1 -- 172.21.15.63:0/2983129193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a00d07b0 msgr2=0x7f23a00cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.262+0000 7f23a5120640 1 --2- 172.21.15.63:0/2983129193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a00d07b0 0x7f23a00cd040 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2388009830 tx=0x7f238802a3e0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.262+0000 7f23a5120640 1 -- 172.21.15.63:0/2983129193 shutdown_connections 2024-09-21T07:01:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.262+0000 7f23a5120640 1 --2- 172.21.15.63:0/2983129193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a00d07b0 0x7f23a00cd040 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.262+0000 7f23a5120640 1 --2- 172.21.15.63:0/2983129193 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a00ceaf0 0x7f23a00d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.262+0000 7f23a5120640 1 -- 172.21.15.63:0/2983129193 >> 172.21.15.63:0/2983129193 conn(0x7f23a00cef40 msgr2=0x7f23a00cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.262+0000 7f23a5120640 1 -- 172.21.15.63:0/2983129193 shutdown_connections 2024-09-21T07:01:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.262+0000 7f23a5120640 1 -- 172.21.15.63:0/2983129193 wait complete. 2024-09-21T07:01:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.264+0000 7f23a5120640 1 Processor -- start 2024-09-21T07:01:34.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.264+0000 7f23a5120640 1 -- start start 2024-09-21T07:01:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f23a5120640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a00cd580 0x7f23a0165d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f23a5120640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a00ceaf0 0x7f23a0166260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f23a5120640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a00d07b0 0x7f23a01f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f23a5120640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f23a00c9370 con 0x7f23a00ceaf0 2024-09-21T07:01:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f23a5120640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f23a00b31d0 con 0x7f23a00d07b0 2024-09-21T07:01:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f23a5120640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f23a0167190 con 0x7f23a00cd580 2024-09-21T07:01:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f239e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a00ceaf0 0x7f23a0166260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f239e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a00ceaf0 0x7f23a0166260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42636/0 (socket says 172.21.15.63:42636) 2024-09-21T07:01:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f239e59c640 1 -- 172.21.15.63:0/1630709956 learned_addr learned my addr 172.21.15.63:0/1630709956 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:34.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f239f59e640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a00d07b0 0x7f23a01f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f239ed9d640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a00cd580 0x7f23a0165d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f239e59c640 1 -- 172.21.15.63:0/1630709956 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a00cd580 msgr2=0x7f23a0165d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f239e59c640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f23a00cd580 0x7f23a0165d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f239e59c640 1 -- 172.21.15.63:0/1630709956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a00d07b0 msgr2=0x7f23a01f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f239e59c640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f23a00d07b0 0x7f23a01f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.266+0000 7f239e59c640 1 -- 172.21.15.63:0/1630709956 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a014e260 con 0x7f23a00ceaf0 2024-09-21T07:01:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.267+0000 7f239e59c640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a00ceaf0 0x7f23a0166260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2388009950 tx=0x7f2388033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.267+0000 7f23977fe640 1 -- 172.21.15.63:0/1630709956 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388005c90 con 0x7f23a00ceaf0 2024-09-21T07:01:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.267+0000 7f23977fe640 1 -- 172.21.15.63:0/1630709956 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2388031e50 con 0x7f23a00ceaf0 2024-09-21T07:01:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.267+0000 7f23a5120640 1 -- 172.21.15.63:0/1630709956 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a015eba0 con 0x7f23a00ceaf0 2024-09-21T07:01:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.267+0000 7f23977fe640 1 -- 172.21.15.63:0/1630709956 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388005260 con 0x7f23a00ceaf0 2024-09-21T07:01:34.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.267+0000 7f23a5120640 1 -- 172.21.15.63:0/1630709956 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a015f160 con 0x7f23a00ceaf0 2024-09-21T07:01:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.268+0000 7f23a5120640 1 -- 172.21.15.63:0/1630709956 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f23a00d0270 con 0x7f23a00ceaf0 2024-09-21T07:01:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.269+0000 7f23977fe640 1 -- 172.21.15.63:0/1630709956 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2388005400 con 0x7f23a00ceaf0 2024-09-21T07:01:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.269+0000 7f23977fe640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2380078b90 0x7f238007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.269+0000 7f23977fe640 1 -- 172.21.15.63:0/1630709956 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f23880bbbb0 con 0x7f23a00ceaf0 2024-09-21T07:01:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.269+0000 7f239ed9d640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2380078b90 0x7f238007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.269+0000 7f23977fe640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] conn(0x7f238007eb40 0x7f2380080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.269+0000 7f23977fe640 1 -- 172.21.15.63:0/1630709956 --> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23880317a0 con 0x7f238007eb40 2024-09-21T07:01:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.269+0000 7f23977fe640 1 -- 172.21.15.63:0/1630709956 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f23880be2b0 con 0x7f23a00ceaf0 2024-09-21T07:01:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.270+0000 7f239f59e640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] conn(0x7f238007eb40 0x7f2380080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.270+0000 7f239ed9d640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2380078b90 0x7f238007b0a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2398009c00 tx=0x7f2398005f30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:34.272 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.270+0000 7f239f59e640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] conn(0x7f238007eb40 0x7f2380080f90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:34.273 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.271+0000 7f23977fe640 1 -- 172.21.15.63:0/1630709956 <== osd.0 v2:172.21.15.63:6800/1037303619 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f23880317a0 con 0x7f238007eb40 2024-09-21T07:01:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.283+0000 7f23a5120640 1 -- 172.21.15.63:0/1630709956 --> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f23a00b77d0 con 0x7f238007eb40 2024-09-21T07:01:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.283+0000 7f23977fe640 1 -- 172.21.15.63:0/1630709956 <== osd.0 v2:172.21.15.63:6800/1037303619 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f23a00b77d0 con 0x7f238007eb40 2024-09-21T07:01:34.285 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T07:01:34.285 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:01:34.285 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T07:01:34.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.284+0000 7f23a5120640 1 -- 172.21.15.63:0/1630709956 >> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] conn(0x7f238007eb40 msgr2=0x7f2380080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.284+0000 7f23a5120640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.63:6800/1037303619,v1:172.21.15.63:6801/1037303619] conn(0x7f238007eb40 0x7f2380080f90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.284+0000 7f23a5120640 1 -- 172.21.15.63:0/1630709956 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2380078b90 msgr2=0x7f238007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.284+0000 7f23a5120640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f2380078b90 0x7f238007b0a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2398009c00 tx=0x7f2398005f30 comp rx=0 tx=0).stop 2024-09-21T07:01:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.284+0000 7f23a5120640 1 -- 172.21.15.63:0/1630709956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a00ceaf0 msgr2=0x7f23a0166260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.284+0000 7f23a5120640 1 --2- 172.21.15.63:0/1630709956 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23a00ceaf0 0x7f23a0166260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2388009950 tx=0x7f2388033c20 comp rx=0 tx=0).stop 2024-09-21T07:01:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.284+0000 7f239f59e640 1 -- 172.21.15.63:0/1630709956 reap_dead start 2024-09-21T07:01:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.284+0000 7f23a5120640 1 -- 172.21.15.63:0/1630709956 shutdown_connections 2024-09-21T07:01:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.284+0000 7f23a5120640 1 -- 172.21.15.63:0/1630709956 >> 172.21.15.63:0/1630709956 conn(0x7f23a00cef40 msgr2=0x7f23a0072800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.284+0000 7f23a5120640 1 -- 172.21.15.63:0/1630709956 shutdown_connections 2024-09-21T07:01:34.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.284+0000 7f23a5120640 1 -- 172.21.15.63:0/1630709956 wait complete. 2024-09-21T07:01:34.296 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T07:01:34.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.412+0000 7f5508abd640 1 -- 172.21.15.63:0/3613900746 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55040b3750 msgr2=0x7f550409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.412+0000 7f5508abd640 1 --2- 172.21.15.63:0/3613900746 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55040b3750 0x7f550409aa40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009be0 tx=0x7f54f402a920 comp rx=0 tx=0).stop 2024-09-21T07:01:34.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.412+0000 7f5508abd640 1 -- 172.21.15.63:0/3613900746 shutdown_connections 2024-09-21T07:01:34.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.412+0000 7f5508abd640 1 --2- 172.21.15.63:0/3613900746 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55040b3750 0x7f550409aa40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.412+0000 7f5508abd640 1 -- 172.21.15.63:0/3613900746 >> 172.21.15.63:0/3613900746 conn(0x7f55040b3fb0 msgr2=0x7f55040b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:34.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.412+0000 7f5508abd640 1 -- 172.21.15.63:0/3613900746 shutdown_connections 2024-09-21T07:01:34.415 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.412+0000 7f5508abd640 1 -- 172.21.15.63:0/3613900746 wait complete. 2024-09-21T07:01:34.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.414+0000 7f5508abd640 1 Processor -- start 2024-09-21T07:01:34.416 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.414+0000 7f5508abd640 1 -- start start 2024-09-21T07:01:34.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5508abd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550409af80 0x7f550406e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5508abd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55040b3750 0x7f55041f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5508abd640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55040b3b60 0x7f55041f9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5508abd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f55040b6c00 con 0x7f55040b3750 2024-09-21T07:01:34.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5508abd640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55040b6a80 con 0x7f550409af80 2024-09-21T07:01:34.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5508abd640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f55040b6d80 con 0x7f55040b3b60 2024-09-21T07:01:34.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5501d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55040b3750 0x7f55041f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f550259c640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550409af80 0x7f550406e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5501d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55040b3750 0x7f55041f8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42644/0 (socket says 172.21.15.63:42644) 2024-09-21T07:01:34.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5501d9b640 1 -- 172.21.15.63:0/538035701 learned_addr learned my addr 172.21.15.63:0/538035701 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:34.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5502d9d640 1 --2- 172.21.15.63:0/538035701 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55040b3b60 0x7f55041f9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5501d9b640 1 -- 172.21.15.63:0/538035701 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55040b3b60 msgr2=0x7f55041f9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5501d9b640 1 --2- 172.21.15.63:0/538035701 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55040b3b60 0x7f55041f9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5501d9b640 1 -- 172.21.15.63:0/538035701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550409af80 msgr2=0x7f550406e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5501d9b640 1 --2- 172.21.15.63:0/538035701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550409af80 0x7f550406e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5501d9b640 1 -- 172.21.15.63:0/538035701 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550406fed0 con 0x7f55040b3750 2024-09-21T07:01:34.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.416+0000 7f5501d9b640 1 --2- 172.21.15.63:0/538035701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55040b3750 0x7f55041f8ee0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00c430 tx=0x7f54ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:34.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.417+0000 7f54faffd640 1 -- 172.21.15.63:0/538035701 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec017070 con 0x7f55040b3750 2024-09-21T07:01:34.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.417+0000 7f54faffd640 1 -- 172.21.15.63:0/538035701 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f54ec0053e0 con 0x7f55040b3750 2024-09-21T07:01:34.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.417+0000 7f5508abd640 1 -- 172.21.15.63:0/538035701 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550406ee30 con 0x7f55040b3750 2024-09-21T07:01:34.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.417+0000 7f54faffd640 1 -- 172.21.15.63:0/538035701 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec003850 con 0x7f55040b3750 2024-09-21T07:01:34.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.417+0000 7f5508abd640 1 -- 172.21.15.63:0/538035701 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550406f3f0 con 0x7f55040b3750 2024-09-21T07:01:34.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.418+0000 7f5508abd640 1 -- 172.21.15.63:0/538035701 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f550406eb70 con 0x7f55040b3750 2024-09-21T07:01:34.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.418+0000 7f54faffd640 1 -- 172.21.15.63:0/538035701 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f54ec01a070 con 0x7f55040b3750 2024-09-21T07:01:34.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.419+0000 7f54faffd640 1 --2- 172.21.15.63:0/538035701 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f54e4078b90 0x7f54e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.419+0000 7f54faffd640 1 -- 172.21.15.63:0/538035701 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f54ec099e70 con 0x7f55040b3750 2024-09-21T07:01:34.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.419+0000 7f550259c640 1 --2- 172.21.15.63:0/538035701 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f54e4078b90 0x7f54e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.420+0000 7f550259c640 1 --2- 172.21.15.63:0/538035701 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f54e4078b90 0x7f54e407b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f54f4034000 tx=0x7f54f4004ab0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:34.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.423+0000 7f54faffd640 1 -- 172.21.15.63:0/538035701 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f54ec061e80 con 0x7f55040b3750 2024-09-21T07:01:34.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.612+0000 7f5508abd640 1 -- 172.21.15.63:0/538035701 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f55040b7230 con 0x7f54e4078b90 2024-09-21T07:01:34.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.612+0000 7f54faffd640 1 -- 172.21.15.63:0/538035701 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f55040b7230 con 0x7f54e4078b90 2024-09-21T07:01:34.614 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T07:01:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.615+0000 7f5508abd640 1 -- 172.21.15.63:0/538035701 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f54e4078b90 msgr2=0x7f54e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.615+0000 7f5508abd640 1 --2- 172.21.15.63:0/538035701 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f54e4078b90 0x7f54e407b0a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f54f4034000 tx=0x7f54f4004ab0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.615+0000 7f5508abd640 1 -- 172.21.15.63:0/538035701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55040b3750 msgr2=0x7f55041f8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.615+0000 7f5508abd640 1 --2- 172.21.15.63:0/538035701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55040b3750 0x7f55041f8ee0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00c430 tx=0x7f54ec00c8f0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.615+0000 7f5508abd640 1 -- 172.21.15.63:0/538035701 shutdown_connections 2024-09-21T07:01:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.615+0000 7f5508abd640 1 --2- 172.21.15.63:0/538035701 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f54e4078b90 0x7f54e407b0a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.615+0000 7f5508abd640 1 --2- 172.21.15.63:0/538035701 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55040b3b60 0x7f55041f9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.615+0000 7f5508abd640 1 --2- 172.21.15.63:0/538035701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55040b3750 0x7f55041f8ee0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.615+0000 7f5508abd640 1 --2- 172.21.15.63:0/538035701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f550409af80 0x7f550406e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.615+0000 7f5508abd640 1 -- 172.21.15.63:0/538035701 >> 172.21.15.63:0/538035701 conn(0x7f55040b3fb0 msgr2=0x7f5504071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.615+0000 7f5508abd640 1 -- 172.21.15.63:0/538035701 shutdown_connections 2024-09-21T07:01:34.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.615+0000 7f5508abd640 1 -- 172.21.15.63:0/538035701 wait complete. 2024-09-21T07:01:34.628 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T07:01:34.628 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:01:34.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.747+0000 7fdc6020e640 1 -- 172.21.15.63:0/3935079769 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc581679b0 msgr2=0x7fdc58169dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.747+0000 7fdc6020e640 1 --2- 172.21.15.63:0/3935079769 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc581679b0 0x7fdc58169dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009b60 tx=0x7fdc5002a870 comp rx=0 tx=0).stop 2024-09-21T07:01:34.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.747+0000 7fdc6020e640 1 -- 172.21.15.63:0/3935079769 shutdown_connections 2024-09-21T07:01:34.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.747+0000 7fdc6020e640 1 --2- 172.21.15.63:0/3935079769 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc581679b0 0x7fdc58169dd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.747+0000 7fdc6020e640 1 -- 172.21.15.63:0/3935079769 >> 172.21.15.63:0/3935079769 conn(0x7fdc580d4680 msgr2=0x7fdc580d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:34.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.747+0000 7fdc6020e640 1 -- 172.21.15.63:0/3935079769 shutdown_connections 2024-09-21T07:01:34.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.747+0000 7fdc6020e640 1 -- 172.21.15.63:0/3935079769 wait complete. 2024-09-21T07:01:34.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.749+0000 7fdc6020e640 1 Processor -- start 2024-09-21T07:01:34.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.749+0000 7fdc6020e640 1 -- start start 2024-09-21T07:01:34.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.750+0000 7fdc6020e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc580b33f0 0x7fdc5814fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.750+0000 7fdc6020e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc580d2a60 0x7fdc58163990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.750+0000 7fdc6020e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc581679b0 0x7fdc580b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.750+0000 7fdc6020e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5816a490 con 0x7fdc580d2a60 2024-09-21T07:01:34.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.750+0000 7fdc6020e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5816a310 con 0x7fdc580b33f0 2024-09-21T07:01:34.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.750+0000 7fdc6020e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5816a610 con 0x7fdc581679b0 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc5d7a9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc580d2a60 0x7fdc58163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc5dfaa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc580b33f0 0x7fdc5814fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc5d7a9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc580d2a60 0x7fdc58163990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42660/0 (socket says 172.21.15.63:42660) 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc5dfaa640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc580b33f0 0x7fdc5814fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.63:55024/0 (socket says 172.21.15.63:55024) 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc5d7a9640 1 -- 172.21.15.63:0/1494607044 learned_addr learned my addr 172.21.15.63:0/1494607044 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc5e7ab640 1 --2- 172.21.15.63:0/1494607044 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc581679b0 0x7fdc580b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc5d7a9640 1 -- 172.21.15.63:0/1494607044 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc581679b0 msgr2=0x7fdc580b8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc5d7a9640 1 --2- 172.21.15.63:0/1494607044 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc581679b0 0x7fdc580b8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc5d7a9640 1 -- 172.21.15.63:0/1494607044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc580b33f0 msgr2=0x7fdc5814fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc5d7a9640 1 --2- 172.21.15.63:0/1494607044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc580b33f0 0x7fdc5814fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc5d7a9640 1 -- 172.21.15.63:0/1494607044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc580b5c40 con 0x7fdc580d2a60 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc5d7a9640 1 --2- 172.21.15.63:0/1494607044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc580d2a60 0x7fdc58163990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800c730 tx=0x7fdc4800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc4e7fc640 1 -- 172.21.15.63:0/1494607044 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4800ce40 con 0x7fdc580d2a60 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc4e7fc640 1 -- 172.21.15.63:0/1494607044 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc4800a640 con 0x7fdc580d2a60 2024-09-21T07:01:34.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc6020e640 1 -- 172.21.15.63:0/1494607044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc580b5f20 con 0x7fdc580d2a60 2024-09-21T07:01:34.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc4e7fc640 1 -- 172.21.15.63:0/1494607044 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4800aa90 con 0x7fdc580d2a60 2024-09-21T07:01:34.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.751+0000 7fdc6020e640 1 -- 172.21.15.63:0/1494607044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc580b64e0 con 0x7fdc580d2a60 2024-09-21T07:01:34.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.752+0000 7fdc6020e640 1 -- 172.21.15.63:0/1494607044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc5806dfe0 con 0x7fdc580d2a60 2024-09-21T07:01:34.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.753+0000 7fdc4e7fc640 1 -- 172.21.15.63:0/1494607044 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc4800ac30 con 0x7fdc580d2a60 2024-09-21T07:01:34.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.754+0000 7fdc4e7fc640 1 --2- 172.21.15.63:0/1494607044 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdc3c078b90 0x7fdc3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.754+0000 7fdc4e7fc640 1 -- 172.21.15.63:0/1494607044 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7fdc4809b2b0 con 0x7fdc580d2a60 2024-09-21T07:01:34.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.754+0000 7fdc4e7fc640 1 --2- 172.21.15.63:0/1494607044 >> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] conn(0x7fdc3c07eb40 0x7fdc3c080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.754+0000 7fdc5dfaa640 1 --2- 172.21.15.63:0/1494607044 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdc3c078b90 0x7fdc3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.754+0000 7fdc4e7fc640 1 -- 172.21.15.63:0/1494607044 --> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc48013e70 con 0x7fdc3c07eb40 2024-09-21T07:01:34.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.754+0000 7fdc4e7fc640 1 -- 172.21.15.63:0/1494607044 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fdc4809b740 con 0x7fdc580d2a60 2024-09-21T07:01:34.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.754+0000 7fdc5e7ab640 1 --2- 172.21.15.63:0/1494607044 >> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] conn(0x7fdc3c07eb40 0x7fdc3c080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.755+0000 7fdc5dfaa640 1 --2- 172.21.15.63:0/1494607044 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdc3c078b90 0x7fdc3c07b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdc580b40b0 tx=0x7fdc54001cd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:34.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.755+0000 7fdc5e7ab640 1 --2- 172.21.15.63:0/1494607044 >> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] conn(0x7fdc3c07eb40 0x7fdc3c080f90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:34.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.755+0000 7fdc4e7fc640 1 -- 172.21.15.63:0/1494607044 <== osd.1 v2:172.21.15.63:6808/2756858470 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc48013e70 con 0x7fdc3c07eb40 2024-09-21T07:01:34.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.768+0000 7fdc6020e640 1 -- 172.21.15.63:0/1494607044 --> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdc580b59f0 con 0x7fdc3c07eb40 2024-09-21T07:01:34.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.768+0000 7fdc4e7fc640 1 -- 172.21.15.63:0/1494607044 <== osd.1 v2:172.21.15.63:6808/2756858470 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdc580b59f0 con 0x7fdc3c07eb40 2024-09-21T07:01:34.770 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T07:01:34.770 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:01:34.770 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T07:01:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.768+0000 7fdc6020e640 1 -- 172.21.15.63:0/1494607044 >> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] conn(0x7fdc3c07eb40 msgr2=0x7fdc3c080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.768+0000 7fdc6020e640 1 --2- 172.21.15.63:0/1494607044 >> [v2:172.21.15.63:6808/2756858470,v1:172.21.15.63:6809/2756858470] conn(0x7fdc3c07eb40 0x7fdc3c080f90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.768+0000 7fdc6020e640 1 -- 172.21.15.63:0/1494607044 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdc3c078b90 msgr2=0x7fdc3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.768+0000 7fdc6020e640 1 --2- 172.21.15.63:0/1494607044 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdc3c078b90 0x7fdc3c07b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdc580b40b0 tx=0x7fdc54001cd0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.768+0000 7fdc6020e640 1 -- 172.21.15.63:0/1494607044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc580d2a60 msgr2=0x7fdc58163990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.769+0000 7fdc6020e640 1 --2- 172.21.15.63:0/1494607044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc580d2a60 0x7fdc58163990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800c730 tx=0x7fdc4800cbf0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.769+0000 7fdc5e7ab640 1 -- 172.21.15.63:0/1494607044 reap_dead start 2024-09-21T07:01:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.769+0000 7fdc6020e640 1 -- 172.21.15.63:0/1494607044 shutdown_connections 2024-09-21T07:01:34.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.769+0000 7fdc6020e640 1 -- 172.21.15.63:0/1494607044 >> 172.21.15.63:0/1494607044 conn(0x7fdc580d4680 msgr2=0x7fdc580b2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:34.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.769+0000 7fdc6020e640 1 -- 172.21.15.63:0/1494607044 shutdown_connections 2024-09-21T07:01:34.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.769+0000 7fdc6020e640 1 -- 172.21.15.63:0/1494607044 wait complete. 2024-09-21T07:01:34.781 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T07:01:34.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.896+0000 7f1f70f58640 1 -- 172.21.15.63:0/3986796875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f6c0b52a0 msgr2=0x7f1f6c0b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.896+0000 7f1f70f58640 1 --2- 172.21.15.63:0/3986796875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f6c0b52a0 0x7f1f6c0b56b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c052000 tx=0x7f1f5402a4d0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.896+0000 7f1f70f58640 1 -- 172.21.15.63:0/3986796875 shutdown_connections 2024-09-21T07:01:34.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.896+0000 7f1f70f58640 1 --2- 172.21.15.63:0/3986796875 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f6c160bd0 0x7f1f6c160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.896+0000 7f1f70f58640 1 --2- 172.21.15.63:0/3986796875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f6c0b52a0 0x7f1f6c0b56b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.896+0000 7f1f70f58640 1 --2- 172.21.15.63:0/3986796875 >> v2:172.21.15.71:3300/0 conn(0x7f1f6c0d0350 0x7f1f6c0d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.896+0000 7f1f70f58640 1 -- 172.21.15.63:0/3986796875 >> 172.21.15.63:0/3986796875 conn(0x7f1f6c0ceed0 msgr2=0x7f1f6c0cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:34.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.896+0000 7f1f70f58640 1 -- 172.21.15.63:0/3986796875 shutdown_connections 2024-09-21T07:01:34.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.896+0000 7f1f70f58640 1 -- 172.21.15.63:0/3986796875 wait complete. 2024-09-21T07:01:34.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.898+0000 7f1f70f58640 1 Processor -- start 2024-09-21T07:01:34.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.898+0000 7f1f70f58640 1 -- start start 2024-09-21T07:01:34.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f70f58640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f6c0b52a0 0x7f1f6c156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f70f58640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f6c0d0350 0x7f1f6c0c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f70f58640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f6c160bd0 0x7f1f6c15be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f70f58640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c0b5bf0 con 0x7f1f6c0d0350 2024-09-21T07:01:34.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f70f58640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c0d0760 con 0x7f1f6c0b52a0 2024-09-21T07:01:34.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f70f58640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f1f6c0b8280 con 0x7f1f6c160bd0 2024-09-21T07:01:34.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f69d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f6c0d0350 0x7f1f6c0c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f69d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f6c0d0350 0x7f1f6c0c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42680/0 (socket says 172.21.15.63:42680) 2024-09-21T07:01:34.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f69d9b640 1 -- 172.21.15.63:0/1047647056 learned_addr learned my addr 172.21.15.63:0/1047647056 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:34.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f6a59c640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f6c0b52a0 0x7f1f6c156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f6ad9d640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f6c160bd0 0x7f1f6c15be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f6a59c640 1 -- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f6c160bd0 msgr2=0x7f1f6c15be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f6a59c640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f6c160bd0 0x7f1f6c15be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f6a59c640 1 -- 172.21.15.63:0/1047647056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f6c0d0350 msgr2=0x7f1f6c0c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:34.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f6a59c640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f6c0d0350 0x7f1f6c0c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:34.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f6a59c640 1 -- 172.21.15.63:0/1047647056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6c0ca580 con 0x7f1f6c0b52a0 2024-09-21T07:01:34.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f69d9b640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f6c0d0350 0x7f1f6c0c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T07:01:34.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.900+0000 7f1f6a59c640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f6c0b52a0 0x7f1f6c156a30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00ebc0 tx=0x7f1f5c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:34.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.901+0000 7f1f62ffd640 1 -- 172.21.15.63:0/1047647056 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c004d40 con 0x7f1f6c0b52a0 2024-09-21T07:01:34.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.901+0000 7f1f62ffd640 1 -- 172.21.15.63:0/1047647056 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f5c003970 con 0x7f1f6c0b52a0 2024-09-21T07:01:34.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.901+0000 7f1f70f58640 1 -- 172.21.15.63:0/1047647056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6c0c9fc0 con 0x7f1f6c0b52a0 2024-09-21T07:01:34.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.901+0000 7f1f62ffd640 1 -- 172.21.15.63:0/1047647056 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c003dc0 con 0x7f1f6c0b52a0 2024-09-21T07:01:34.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.901+0000 7f1f70f58640 1 -- 172.21.15.63:0/1047647056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f6c0c6020 con 0x7f1f6c0b52a0 2024-09-21T07:01:34.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.902+0000 7f1f70f58640 1 -- 172.21.15.63:0/1047647056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6c0b75e0 con 0x7f1f6c0b52a0 2024-09-21T07:01:34.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.903+0000 7f1f62ffd640 1 -- 172.21.15.63:0/1047647056 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f5c004020 con 0x7f1f6c0b52a0 2024-09-21T07:01:34.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.903+0000 7f1f62ffd640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1f4c078bc0 0x7f1f4c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:34.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.903+0000 7f1f62ffd640 1 -- 172.21.15.63:0/1047647056 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f1f5c09bad0 con 0x7f1f6c0b52a0 2024-09-21T07:01:34.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.903+0000 7f1f69d9b640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1f4c078bc0 0x7f1f4c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:34.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.904+0000 7f1f69d9b640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1f4c078bc0 0x7f1f4c07b0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009230 tx=0x7f1f54004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:34.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:34.907+0000 7f1f62ffd640 1 -- 172.21.15.63:0/1047647056 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f1f5c063bf0 con 0x7f1f6c0b52a0 2024-09-21T07:01:35.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.093+0000 7f1f70f58640 1 -- 172.21.15.63:0/1047647056 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f1f6c0b6f30 con 0x7f1f4c078bc0 2024-09-21T07:01:35.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.094+0000 7f1f62ffd640 1 -- 172.21.15.63:0/1047647056 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1f6c0b6f30 con 0x7f1f4c078bc0 2024-09-21T07:01:35.096 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T07:01:35.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.096+0000 7f1f70f58640 1 -- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1f4c078bc0 msgr2=0x7f1f4c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.096+0000 7f1f70f58640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1f4c078bc0 0x7f1f4c07b0d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f54009230 tx=0x7f1f54004730 comp rx=0 tx=0).stop 2024-09-21T07:01:35.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.096+0000 7f1f70f58640 1 -- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f6c0b52a0 msgr2=0x7f1f6c156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.096+0000 7f1f70f58640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f6c0b52a0 0x7f1f6c156a30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00ebc0 tx=0x7f1f5c00c6a0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.096+0000 7f1f70f58640 1 -- 172.21.15.63:0/1047647056 shutdown_connections 2024-09-21T07:01:35.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.096+0000 7f1f70f58640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f1f4c078bc0 0x7f1f4c07b0d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.096+0000 7f1f70f58640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f1f6c160bd0 0x7f1f6c15be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.096+0000 7f1f70f58640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1f6c0d0350 0x7f1f6c0c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.096+0000 7f1f70f58640 1 --2- 172.21.15.63:0/1047647056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f6c0b52a0 0x7f1f6c156a30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.096+0000 7f1f70f58640 1 -- 172.21.15.63:0/1047647056 >> 172.21.15.63:0/1047647056 conn(0x7f1f6c0ceed0 msgr2=0x7f1f6c0712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:35.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.096+0000 7f1f70f58640 1 -- 172.21.15.63:0/1047647056 shutdown_connections 2024-09-21T07:01:35.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.096+0000 7f1f70f58640 1 -- 172.21.15.63:0/1047647056 wait complete. 2024-09-21T07:01:35.109 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T07:01:35.110 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:01:35.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.228+0000 7f7588d13640 1 -- 172.21.15.63:0/1218684614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75840cf120 msgr2=0x7f75840cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.228+0000 7f7588d13640 1 --2- 172.21.15.63:0/1218684614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75840cf120 0x7f75840cf530 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f75840ba570 tx=0x7f757c02a5f0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.228+0000 7f7588d13640 1 -- 172.21.15.63:0/1218684614 shutdown_connections 2024-09-21T07:01:35.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.228+0000 7f7588d13640 1 --2- 172.21.15.63:0/1218684614 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f75840cf120 0x7f75840cf530 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.228+0000 7f7588d13640 1 --2- 172.21.15.63:0/1218684614 >> v2:172.21.15.71:3300/0 conn(0x7f758406f3f0 0x7f75840b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.228+0000 7f7588d13640 1 -- 172.21.15.63:0/1218684614 >> 172.21.15.63:0/1218684614 conn(0x7f75840d46a0 msgr2=0x7f75840d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:35.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.228+0000 7f7588d13640 1 -- 172.21.15.63:0/1218684614 shutdown_connections 2024-09-21T07:01:35.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.228+0000 7f7588d13640 1 -- 172.21.15.63:0/1218684614 wait complete. 2024-09-21T07:01:35.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.230+0000 7f7588d13640 1 Processor -- start 2024-09-21T07:01:35.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.230+0000 7f7588d13640 1 -- start start 2024-09-21T07:01:35.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.231+0000 7f7588d13640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f758406f3f0 0x7f75841f9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.231+0000 7f7588d13640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75840b9c30 0x7f75840c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.231+0000 7f7588d13640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75840cf120 0x7f7584160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.231+0000 7f7588d13640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f75840cfbf0 con 0x7f758406f3f0 2024-09-21T07:01:35.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.231+0000 7f7588d13640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f75840cfa70 con 0x7f75840b9c30 2024-09-21T07:01:35.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.231+0000 7f7588d13640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f75840cfd70 con 0x7f75840cf120 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f758259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f758406f3f0 0x7f75841f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f758259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f758406f3f0 0x7f75841f9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42704/0 (socket says 172.21.15.63:42704) 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f758259c640 1 -- 172.21.15.63:0/3945196308 learned_addr learned my addr 172.21.15.63:0/3945196308 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f7581d9b640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75840b9c30 0x7f75840c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f7582d9d640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75840cf120 0x7f7584160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f758259c640 1 -- 172.21.15.63:0/3945196308 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75840cf120 msgr2=0x7f7584160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f758259c640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f75840cf120 0x7f7584160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f758259c640 1 -- 172.21.15.63:0/3945196308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75840b9c30 msgr2=0x7f75840c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f758259c640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f75840b9c30 0x7f75840c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f758259c640 1 -- 172.21.15.63:0/3945196308 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758409ed70 con 0x7f758406f3f0 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f758259c640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f758406f3f0 0x7f75841f9600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f757400c730 tx=0x7f757400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f7572ffd640 1 -- 172.21.15.63:0/3945196308 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574017070 con 0x7f758406f3f0 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f7572ffd640 1 -- 172.21.15.63:0/3945196308 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f757400ce40 con 0x7f758406f3f0 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f7588d13640 1 -- 172.21.15.63:0/3945196308 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758409f050 con 0x7f758406f3f0 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f7572ffd640 1 -- 172.21.15.63:0/3945196308 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75740052d0 con 0x7f758406f3f0 2024-09-21T07:01:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.232+0000 7f7588d13640 1 -- 172.21.15.63:0/3945196308 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75840c8510 con 0x7f758406f3f0 2024-09-21T07:01:35.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.233+0000 7f7588d13640 1 -- 172.21.15.63:0/3945196308 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f75840d0230 con 0x7f758406f3f0 2024-09-21T07:01:35.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.234+0000 7f7572ffd640 1 -- 172.21.15.63:0/3945196308 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f757401a070 con 0x7f758406f3f0 2024-09-21T07:01:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.235+0000 7f7572ffd640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7564078bc0 0x7f756407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.235+0000 7f7572ffd640 1 -- 172.21.15.63:0/3945196308 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f757409a640 con 0x7f758406f3f0 2024-09-21T07:01:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.235+0000 7f7581d9b640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7564078bc0 0x7f756407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.235+0000 7f7572ffd640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] conn(0x7f756407eb70 0x7f7564080fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.235+0000 7f7572ffd640 1 -- 172.21.15.63:0/3945196308 --> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7564081690 con 0x7f756407eb70 2024-09-21T07:01:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.235+0000 7f7572ffd640 1 -- 172.21.15.63:0/3945196308 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f757409aad0 con 0x7f758406f3f0 2024-09-21T07:01:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.235+0000 7f7582d9d640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] conn(0x7f756407eb70 0x7f7564080fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.236+0000 7f7581d9b640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7564078bc0 0x7f756407b0d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f75840c9400 tx=0x7f757800a250 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:35.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.236+0000 7f7582d9d640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] conn(0x7f756407eb70 0x7f7564080fc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:35.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.236+0000 7f7572ffd640 1 -- 172.21.15.63:0/3945196308 <== osd.2 v2:172.21.15.63:6823/115139768 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7564081690 con 0x7f756407eb70 2024-09-21T07:01:35.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.249+0000 7f7588d13640 1 -- 172.21.15.63:0/3945196308 --> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7584076000 con 0x7f756407eb70 2024-09-21T07:01:35.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.249+0000 7f7572ffd640 1 -- 172.21.15.63:0/3945196308 <== osd.2 v2:172.21.15.63:6823/115139768 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7584076000 con 0x7f756407eb70 2024-09-21T07:01:35.251 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T07:01:35.251 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:01:35.251 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T07:01:35.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.250+0000 7f7588d13640 1 -- 172.21.15.63:0/3945196308 >> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] conn(0x7f756407eb70 msgr2=0x7f7564080fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.250+0000 7f7588d13640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.63:6823/115139768,v1:172.21.15.63:6825/115139768] conn(0x7f756407eb70 0x7f7564080fc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.250+0000 7f7588d13640 1 -- 172.21.15.63:0/3945196308 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7564078bc0 msgr2=0x7f756407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.250+0000 7f7588d13640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7564078bc0 0x7f756407b0d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f75840c9400 tx=0x7f757800a250 comp rx=0 tx=0).stop 2024-09-21T07:01:35.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.250+0000 7f7588d13640 1 -- 172.21.15.63:0/3945196308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f758406f3f0 msgr2=0x7f75841f9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.250+0000 7f7588d13640 1 --2- 172.21.15.63:0/3945196308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f758406f3f0 0x7f75841f9600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f757400c730 tx=0x7f757400cbf0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.250+0000 7f7582d9d640 1 -- 172.21.15.63:0/3945196308 reap_dead start 2024-09-21T07:01:35.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.250+0000 7f7588d13640 1 -- 172.21.15.63:0/3945196308 shutdown_connections 2024-09-21T07:01:35.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.250+0000 7f7588d13640 1 -- 172.21.15.63:0/3945196308 >> 172.21.15.63:0/3945196308 conn(0x7f75840d46a0 msgr2=0x7f75840b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:35.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.250+0000 7f7588d13640 1 -- 172.21.15.63:0/3945196308 shutdown_connections 2024-09-21T07:01:35.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.250+0000 7f7588d13640 1 -- 172.21.15.63:0/3945196308 wait complete. 2024-09-21T07:01:35.262 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T07:01:35.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.377+0000 7f0b41b94640 1 -- 172.21.15.63:0/820851500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0d1300 msgr2=0x7f0b3c06e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.377+0000 7f0b41b94640 1 --2- 172.21.15.63:0/820851500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0d1300 0x7f0b3c06e930 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005fd0 tx=0x7f0b3402a8b0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.377+0000 7f0b41b94640 1 -- 172.21.15.63:0/820851500 shutdown_connections 2024-09-21T07:01:35.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.377+0000 7f0b41b94640 1 --2- 172.21.15.63:0/820851500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c0d1300 0x7f0b3c06e930 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.377+0000 7f0b41b94640 1 -- 172.21.15.63:0/820851500 >> 172.21.15.63:0/820851500 conn(0x7f0b3c0d45e0 msgr2=0x7f0b3c0d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:35.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.377+0000 7f0b41b94640 1 -- 172.21.15.63:0/820851500 shutdown_connections 2024-09-21T07:01:35.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.377+0000 7f0b41b94640 1 -- 172.21.15.63:0/820851500 wait complete. 2024-09-21T07:01:35.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.379+0000 7f0b41b94640 1 Processor -- start 2024-09-21T07:01:35.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.379+0000 7f0b41b94640 1 -- start start 2024-09-21T07:01:35.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.380+0000 7f0b41b94640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b3c0b3aa0 0x7f0b3c0cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.380+0000 7f0b41b94640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b3c0b9aa0 0x7f0b3c0b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.380+0000 7f0b41b94640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c15d450 0x7f0b3c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.380+0000 7f0b41b94640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c06ee70 con 0x7f0b3c15d450 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.380+0000 7f0b41b94640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c08cc00 con 0x7f0b3c0b3aa0 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b41b94640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f0b3c06eff0 con 0x7f0b3c0b9aa0 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b3bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c15d450 0x7f0b3c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b3bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c15d450 0x7f0b3c15d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42712/0 (socket says 172.21.15.63:42712) 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b3bfff640 1 -- 172.21.15.63:0/2907155363 learned_addr learned my addr 172.21.15.63:0/2907155363 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b3b7fe640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b3c0b3aa0 0x7f0b3c0cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b3affd640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b3c0b9aa0 0x7f0b3c0b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b3bfff640 1 -- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b3c0b9aa0 msgr2=0x7f0b3c0b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b3bfff640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b3c0b9aa0 0x7f0b3c0b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b3bfff640 1 -- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b3c0b3aa0 msgr2=0x7f0b3c0cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b3bfff640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b3c0b3aa0 0x7f0b3c0cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b3bfff640 1 -- 172.21.15.63:0/2907155363 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c0ce3d0 con 0x7f0b3c15d450 2024-09-21T07:01:35.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b3bfff640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c15d450 0x7f0b3c15d860 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0b34006010 tx=0x7f0b34003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:35.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b23fff640 1 -- 172.21.15.63:0/2907155363 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34031b90 con 0x7f0b3c15d450 2024-09-21T07:01:35.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b23fff640 1 -- 172.21.15.63:0/2907155363 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b34031e20 con 0x7f0b3c15d450 2024-09-21T07:01:35.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b23fff640 1 -- 172.21.15.63:0/2907155363 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b340332f0 con 0x7f0b3c15d450 2024-09-21T07:01:35.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.381+0000 7f0b41b94640 1 -- 172.21.15.63:0/2907155363 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3c0ce8e0 con 0x7f0b3c15d450 2024-09-21T07:01:35.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.382+0000 7f0b41b94640 1 -- 172.21.15.63:0/2907155363 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b3c1f5c70 con 0x7f0b3c15d450 2024-09-21T07:01:35.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.383+0000 7f0b41b94640 1 -- 172.21.15.63:0/2907155363 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b3c06e930 con 0x7f0b3c15d450 2024-09-21T07:01:35.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.383+0000 7f0b23fff640 1 -- 172.21.15.63:0/2907155363 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b34031660 con 0x7f0b3c15d450 2024-09-21T07:01:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.384+0000 7f0b23fff640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0b28078b90 0x7f0b2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.384+0000 7f0b23fff640 1 -- 172.21.15.63:0/2907155363 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f0b340bc090 con 0x7f0b3c15d450 2024-09-21T07:01:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.384+0000 7f0b3b7fe640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0b28078b90 0x7f0b2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.385+0000 7f0b3b7fe640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0b28078b90 0x7f0b2807b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c007fd0 tx=0x7f0b2c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:35.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.388+0000 7f0b23fff640 1 -- 172.21.15.63:0/2907155363 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0b3403f030 con 0x7f0b3c15d450 2024-09-21T07:01:35.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.574+0000 7f0b41b94640 1 -- 172.21.15.63:0/2907155363 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f0b3c0ce670 con 0x7f0b28078b90 2024-09-21T07:01:35.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.575+0000 7f0b23fff640 1 -- 172.21.15.63:0/2907155363 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0b3c0ce670 con 0x7f0b28078b90 2024-09-21T07:01:35.576 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T07:01:35.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.577+0000 7f0b41b94640 1 -- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0b28078b90 msgr2=0x7f0b2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.577+0000 7f0b41b94640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0b28078b90 0x7f0b2807b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c007fd0 tx=0x7f0b2c009040 comp rx=0 tx=0).stop 2024-09-21T07:01:35.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.577+0000 7f0b41b94640 1 -- 172.21.15.63:0/2907155363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c15d450 msgr2=0x7f0b3c15d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.577+0000 7f0b41b94640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c15d450 0x7f0b3c15d860 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0b34006010 tx=0x7f0b34003ba0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.577+0000 7f0b41b94640 1 -- 172.21.15.63:0/2907155363 shutdown_connections 2024-09-21T07:01:35.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.577+0000 7f0b41b94640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f0b28078b90 0x7f0b2807b0a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.577+0000 7f0b41b94640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b3c15d450 0x7f0b3c15d860 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.577+0000 7f0b41b94640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f0b3c0b9aa0 0x7f0b3c0b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.577+0000 7f0b41b94640 1 --2- 172.21.15.63:0/2907155363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b3c0b3aa0 0x7f0b3c0cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.577+0000 7f0b41b94640 1 -- 172.21.15.63:0/2907155363 >> 172.21.15.63:0/2907155363 conn(0x7f0b3c0d45e0 msgr2=0x7f0b3c0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:35.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.577+0000 7f0b41b94640 1 -- 172.21.15.63:0/2907155363 shutdown_connections 2024-09-21T07:01:35.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.577+0000 7f0b41b94640 1 -- 172.21.15.63:0/2907155363 wait complete. 2024-09-21T07:01:35.590 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T07:01:35.590 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:01:35.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.708+0000 7f6469f19640 1 -- 172.21.15.63:0/685307205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640cf6e0 msgr2=0x7f64640cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.708+0000 7f6469f19640 1 --2- 172.21.15.63:0/685307205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640cf6e0 0x7f64640cfaf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f646408d5c0 tx=0x7f645c02aa30 comp rx=0 tx=0).stop 2024-09-21T07:01:35.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.708+0000 7f6469f19640 1 -- 172.21.15.63:0/685307205 shutdown_connections 2024-09-21T07:01:35.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.708+0000 7f6469f19640 1 --2- 172.21.15.63:0/685307205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640cf6e0 0x7f64640cfaf0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.708+0000 7f6469f19640 1 --2- 172.21.15.63:0/685307205 >> v2:172.21.15.71:3300/0 conn(0x7f64640b35b0 0x7f64640b9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.708+0000 7f6469f19640 1 -- 172.21.15.63:0/685307205 >> 172.21.15.63:0/685307205 conn(0x7f64640d4680 msgr2=0x7f64640d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:35.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.708+0000 7f6469f19640 1 -- 172.21.15.63:0/685307205 shutdown_connections 2024-09-21T07:01:35.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.708+0000 7f6469f19640 1 -- 172.21.15.63:0/685307205 wait complete. 2024-09-21T07:01:35.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.710+0000 7f6469f19640 1 Processor -- start 2024-09-21T07:01:35.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.710+0000 7f6469f19640 1 -- start start 2024-09-21T07:01:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6469f19640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64640b35b0 0x7f64640cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6469f19640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64640cf6e0 0x7f64641e9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6469f19640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640d1060 0x7f646415eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6469f19640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f64640d1f40 con 0x7f64640d1060 2024-09-21T07:01:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6469f19640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f64640d1dc0 con 0x7f64640b35b0 2024-09-21T07:01:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6469f19640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f64640d0030 con 0x7f64640cf6e0 2024-09-21T07:01:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6463fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640d1060 0x7f646415eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6463fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640d1060 0x7f646415eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42734/0 (socket says 172.21.15.63:42734) 2024-09-21T07:01:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6463fff640 1 -- 172.21.15.63:0/3513615658 learned_addr learned my addr 172.21.15.63:0/3513615658 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f64637fe640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64640b35b0 0x7f64640cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6462ffd640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64640cf6e0 0x7f64641e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6463fff640 1 -- 172.21.15.63:0/3513615658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64640cf6e0 msgr2=0x7f64641e9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6463fff640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f64640cf6e0 0x7f64641e9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6463fff640 1 -- 172.21.15.63:0/3513615658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64640b35b0 msgr2=0x7f64640cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6463fff640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64640b35b0 0x7f64640cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6463fff640 1 -- 172.21.15.63:0/3513615658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64641f69d0 con 0x7f64640d1060 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f64637fe640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f64640b35b0 0x7f64640cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.712+0000 7f6463fff640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640d1060 0x7f646415eb70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f645c009d60 tx=0x7f645c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.713+0000 7f644bfff640 1 -- 172.21.15.63:0/3513615658 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c033050 con 0x7f64640d1060 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.713+0000 7f644bfff640 1 -- 172.21.15.63:0/3513615658 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f645c004450 con 0x7f64640d1060 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.713+0000 7f6469f19640 1 -- 172.21.15.63:0/3513615658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64641f5dc0 con 0x7f64640d1060 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.713+0000 7f644bfff640 1 -- 172.21.15.63:0/3513615658 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c038450 con 0x7f64640d1060 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.713+0000 7f6469f19640 1 -- 172.21.15.63:0/3513615658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64641f6380 con 0x7f64640d1060 2024-09-21T07:01:35.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.713+0000 7f6469f19640 1 -- 172.21.15.63:0/3513615658 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64640d0550 con 0x7f64640d1060 2024-09-21T07:01:35.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.715+0000 7f644bfff640 1 -- 172.21.15.63:0/3513615658 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f645c036070 con 0x7f64640d1060 2024-09-21T07:01:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.715+0000 7f644bfff640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6450078b90 0x7f645007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.715+0000 7f644bfff640 1 -- 172.21.15.63:0/3513615658 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f645c0bc400 con 0x7f64640d1060 2024-09-21T07:01:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.715+0000 7f64637fe640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6450078b90 0x7f645007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.715+0000 7f644bfff640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] conn(0x7f645007eb40 0x7f6450080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.715+0000 7f644bfff640 1 -- 172.21.15.63:0/3513615658 --> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6450081660 con 0x7f645007eb40 2024-09-21T07:01:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.715+0000 7f644bfff640 1 -- 172.21.15.63:0/3513615658 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f645c0bc890 con 0x7f64640d1060 2024-09-21T07:01:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.715+0000 7f6462ffd640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] conn(0x7f645007eb40 0x7f6450080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.716+0000 7f64637fe640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6450078b90 0x7f645007b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64640d08a0 tx=0x7f6454005f30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.716+0000 7f6462ffd640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] conn(0x7f645007eb40 0x7f6450080f90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.716+0000 7f644bfff640 1 -- 172.21.15.63:0/3513615658 <== osd.3 v2:172.21.15.63:6816/1900864594 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6450081660 con 0x7f645007eb40 2024-09-21T07:01:35.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.729+0000 7f6469f19640 1 -- 172.21.15.63:0/3513615658 --> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f64641f5b70 con 0x7f645007eb40 2024-09-21T07:01:35.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.729+0000 7f644bfff640 1 -- 172.21.15.63:0/3513615658 <== osd.3 v2:172.21.15.63:6816/1900864594 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f64641f5b70 con 0x7f645007eb40 2024-09-21T07:01:35.731 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T07:01:35.731 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:01:35.731 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T07:01:35.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.730+0000 7f6469f19640 1 -- 172.21.15.63:0/3513615658 >> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] conn(0x7f645007eb40 msgr2=0x7f6450080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.730+0000 7f6469f19640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.63:6816/1900864594,v1:172.21.15.63:6817/1900864594] conn(0x7f645007eb40 0x7f6450080f90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.730+0000 7f6469f19640 1 -- 172.21.15.63:0/3513615658 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6450078b90 msgr2=0x7f645007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.730+0000 7f6469f19640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6450078b90 0x7f645007b0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64640d08a0 tx=0x7f6454005f30 comp rx=0 tx=0).stop 2024-09-21T07:01:35.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.730+0000 7f6469f19640 1 -- 172.21.15.63:0/3513615658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640d1060 msgr2=0x7f646415eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.730+0000 7f6469f19640 1 --2- 172.21.15.63:0/3513615658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f64640d1060 0x7f646415eb70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f645c009d60 tx=0x7f645c003f10 comp rx=0 tx=0).stop 2024-09-21T07:01:35.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.730+0000 7f6463fff640 1 -- 172.21.15.63:0/3513615658 reap_dead start 2024-09-21T07:01:35.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.730+0000 7f6469f19640 1 -- 172.21.15.63:0/3513615658 shutdown_connections 2024-09-21T07:01:35.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.730+0000 7f6469f19640 1 -- 172.21.15.63:0/3513615658 >> 172.21.15.63:0/3513615658 conn(0x7f64640d4680 msgr2=0x7f64641eac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:35.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.730+0000 7f6469f19640 1 -- 172.21.15.63:0/3513615658 shutdown_connections 2024-09-21T07:01:35.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.730+0000 7f6469f19640 1 -- 172.21.15.63:0/3513615658 wait complete. 2024-09-21T07:01:35.742 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T07:01:35.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.858+0000 7f12ee569640 1 -- 172.21.15.63:0/448215629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12e80b7530 msgr2=0x7f12e80d2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.858+0000 7f12ee569640 1 --2- 172.21.15.63:0/448215629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12e80b7530 0x7f12e80d2530 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f12e80ba3a0 tx=0x7f12d802a5f0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.858+0000 7f12ee569640 1 -- 172.21.15.63:0/448215629 shutdown_connections 2024-09-21T07:01:35.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.858+0000 7f12ee569640 1 --2- 172.21.15.63:0/448215629 >> v2:172.21.15.71:3300/0 conn(0x7f12e80cf310 0x7f12e80cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.858+0000 7f12ee569640 1 --2- 172.21.15.63:0/448215629 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12e80b7530 0x7f12e80d2530 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.858+0000 7f12ee569640 1 -- 172.21.15.63:0/448215629 >> 172.21.15.63:0/448215629 conn(0x7f12e808bfd0 msgr2=0x7f12e80d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:35.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.858+0000 7f12ee569640 1 -- 172.21.15.63:0/448215629 shutdown_connections 2024-09-21T07:01:35.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.858+0000 7f12ee569640 1 -- 172.21.15.63:0/448215629 wait complete. 2024-09-21T07:01:35.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.860+0000 7f12ee569640 1 Processor -- start 2024-09-21T07:01:35.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.860+0000 7f12ee569640 1 -- start start 2024-09-21T07:01:35.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.861+0000 7f12ee569640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12e80b7530 0x7f12e81f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.861+0000 7f12ee569640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12e80cf310 0x7f12e81567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.861+0000 7f12ee569640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f12e815ef00 0x7f12e80ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.861+0000 7f12ee569640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f12e80cfff0 con 0x7f12e80cf310 2024-09-21T07:01:35.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.861+0000 7f12ee569640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12e80cfe70 con 0x7f12e80b7530 2024-09-21T07:01:35.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.861+0000 7f12ee569640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f12e80d0170 con 0x7f12e815ef00 2024-09-21T07:01:35.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.861+0000 7f12e77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12e80cf310 0x7f12e81567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.861+0000 7f12e77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12e80cf310 0x7f12e81567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42762/0 (socket says 172.21.15.63:42762) 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.861+0000 7f12e77fe640 1 -- 172.21.15.63:0/16727091 learned_addr learned my addr 172.21.15.63:0/16727091 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.861+0000 7f12e7fff640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12e80b7530 0x7f12e81f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.862+0000 7f12ecb06640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f12e815ef00 0x7f12e80ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.862+0000 7f12e77fe640 1 -- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f12e815ef00 msgr2=0x7f12e80ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.862+0000 7f12e77fe640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f12e815ef00 0x7f12e80ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.862+0000 7f12e77fe640 1 -- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12e80b7530 msgr2=0x7f12e81f6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.862+0000 7f12e77fe640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12e80b7530 0x7f12e81f6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.862+0000 7f12e77fe640 1 -- 172.21.15.63:0/16727091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e80c8b10 con 0x7f12e80cf310 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.862+0000 7f12e77fe640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12e80cf310 0x7f12e81567e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00c400 tx=0x7f12dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.862+0000 7f12e4ff9640 1 -- 172.21.15.63:0/16727091 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc017070 con 0x7f12e80cf310 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.862+0000 7f12e4ff9640 1 -- 172.21.15.63:0/16727091 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12dc0053c0 con 0x7f12e80cf310 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.862+0000 7f12ee569640 1 -- 172.21.15.63:0/16727091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e80c8db0 con 0x7f12e80cf310 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.862+0000 7f12e4ff9640 1 -- 172.21.15.63:0/16727091 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12dc003850 con 0x7f12e80cf310 2024-09-21T07:01:35.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.862+0000 7f12ee569640 1 -- 172.21.15.63:0/16727091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e80ce070 con 0x7f12e80cf310 2024-09-21T07:01:35.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.863+0000 7f12ee569640 1 -- 172.21.15.63:0/16727091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e80d0670 con 0x7f12e80cf310 2024-09-21T07:01:35.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.864+0000 7f12e4ff9640 1 -- 172.21.15.63:0/16727091 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f12dc01a070 con 0x7f12e80cf310 2024-09-21T07:01:35.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.864+0000 7f12e4ff9640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f12d4078bc0 0x7f12d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:35.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.865+0000 7f12e4ff9640 1 -- 172.21.15.63:0/16727091 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f12dc099d80 con 0x7f12e80cf310 2024-09-21T07:01:35.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.865+0000 7f12e7fff640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f12d4078bc0 0x7f12d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:35.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.865+0000 7f12e7fff640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f12d4078bc0 0x7f12d407b0d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f12d8034000 tx=0x7f12d8004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:35.871 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:35.869+0000 7f12e4ff9640 1 -- 172.21.15.63:0/16727091 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f12dc061e20 con 0x7f12e80cf310 2024-09-21T07:01:36.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.057+0000 7f12ee569640 1 -- 172.21.15.63:0/16727091 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f12e806a130 con 0x7f12d4078bc0 2024-09-21T07:01:36.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.058+0000 7f12e4ff9640 1 -- 172.21.15.63:0/16727091 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f12e806a130 con 0x7f12d4078bc0 2024-09-21T07:01:36.059 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T07:01:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.060+0000 7f12ee569640 1 -- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f12d4078bc0 msgr2=0x7f12d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.060+0000 7f12ee569640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f12d4078bc0 0x7f12d407b0d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f12d8034000 tx=0x7f12d8004730 comp rx=0 tx=0).stop 2024-09-21T07:01:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.060+0000 7f12ee569640 1 -- 172.21.15.63:0/16727091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12e80cf310 msgr2=0x7f12e81567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.060+0000 7f12ee569640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12e80cf310 0x7f12e81567e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00c400 tx=0x7f12dc00c8c0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.060+0000 7f12ee569640 1 -- 172.21.15.63:0/16727091 shutdown_connections 2024-09-21T07:01:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.060+0000 7f12ee569640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f12d4078bc0 0x7f12d407b0d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.060+0000 7f12ee569640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f12e815ef00 0x7f12e80ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.060+0000 7f12ee569640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f12e80cf310 0x7f12e81567e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.060+0000 7f12ee569640 1 --2- 172.21.15.63:0/16727091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12e80b7530 0x7f12e81f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.060+0000 7f12ee569640 1 -- 172.21.15.63:0/16727091 >> 172.21.15.63:0/16727091 conn(0x7f12e808bfd0 msgr2=0x7f12e80b9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.060+0000 7f12ee569640 1 -- 172.21.15.63:0/16727091 shutdown_connections 2024-09-21T07:01:36.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.060+0000 7f12ee569640 1 -- 172.21.15.63:0/16727091 wait complete. 2024-09-21T07:01:36.073 INFO:tasks.ceph:Scrubbing osd.4 2024-09-21T07:01:36.073 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:01:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.192+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2375987491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc340d0130 msgr2=0x7fdc340b6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.192+0000 7fdc3c7f1640 1 --2- 172.21.15.63:0/2375987491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc340d0130 0x7fdc340b6a70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c005fd0 tx=0x7fdc2c02a8a0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.192+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2375987491 shutdown_connections 2024-09-21T07:01:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.192+0000 7fdc3c7f1640 1 --2- 172.21.15.63:0/2375987491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc340d0130 0x7fdc340b6a70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.192+0000 7fdc3c7f1640 1 --2- 172.21.15.63:0/2375987491 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc340b9c30 0x7fdc340b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.192+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2375987491 >> 172.21.15.63:0/2375987491 conn(0x7fdc340d46a0 msgr2=0x7fdc340d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.193+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2375987491 shutdown_connections 2024-09-21T07:01:36.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.193+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2375987491 wait complete. 2024-09-21T07:01:36.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.194+0000 7fdc3c7f1640 1 Processor -- start 2024-09-21T07:01:36.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.194+0000 7fdc3c7f1640 1 -- start start 2024-09-21T07:01:36.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3c7f1640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc340b6660 0x7fdc340caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3c7f1640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc340b9c30 0x7fdc341e9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3c7f1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc340d0130 0x7fdc341e97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3c7f1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3406eec0 con 0x7fdc340d0130 2024-09-21T07:01:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3c7f1640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3406ed40 con 0x7fdc340b6660 2024-09-21T07:01:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3c7f1640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fdc3406f040 con 0x7fdc340b9c30 2024-09-21T07:01:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3ad8e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc340d0130 0x7fdc341e97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3a58d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc340b6660 0x7fdc340caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc39d8c640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc340b9c30 0x7fdc341e9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3ad8e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc340d0130 0x7fdc341e97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42766/0 (socket says 172.21.15.63:42766) 2024-09-21T07:01:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3ad8e640 1 -- 172.21.15.63:0/2913630794 learned_addr learned my addr 172.21.15.63:0/2913630794 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3a58d640 1 -- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc340b9c30 msgr2=0x7fdc341e9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3a58d640 1 --2- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fdc340b9c30 0x7fdc341e9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3a58d640 1 -- 172.21.15.63:0/2913630794 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc340d0130 msgr2=0x7fdc341e97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3a58d640 1 --2- 172.21.15.63:0/2913630794 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc340d0130 0x7fdc341e97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3a58d640 1 -- 172.21.15.63:0/2913630794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc340b4b70 con 0x7fdc340b6660 2024-09-21T07:01:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.196+0000 7fdc3a58d640 1 --2- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc340b6660 0x7fdc340caa70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800ea20 tx=0x7fdc2800eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.197+0000 7fdc26ffd640 1 -- 172.21.15.63:0/2913630794 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800ccc0 con 0x7fdc340b6660 2024-09-21T07:01:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.197+0000 7fdc26ffd640 1 -- 172.21.15.63:0/2913630794 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc28004020 con 0x7fdc340b6660 2024-09-21T07:01:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.197+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2913630794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc340b4e50 con 0x7fdc340b6660 2024-09-21T07:01:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.197+0000 7fdc26ffd640 1 -- 172.21.15.63:0/2913630794 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc28004450 con 0x7fdc340b6660 2024-09-21T07:01:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.197+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2913630794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc340cd070 con 0x7fdc340b6660 2024-09-21T07:01:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.198+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2913630794 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc3406f560 con 0x7fdc340b6660 2024-09-21T07:01:36.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.199+0000 7fdc26ffd640 1 -- 172.21.15.63:0/2913630794 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdc280047c0 con 0x7fdc340b6660 2024-09-21T07:01:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.199+0000 7fdc26ffd640 1 --2- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdc18078b90 0x7fdc1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.199+0000 7fdc26ffd640 1 -- 172.21.15.63:0/2913630794 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7fdc2809b190 con 0x7fdc340b6660 2024-09-21T07:01:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.199+0000 7fdc39d8c640 1 --2- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdc18078b90 0x7fdc1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.199+0000 7fdc26ffd640 1 --2- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] conn(0x7fdc1807eb40 0x7fdc18080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.199+0000 7fdc26ffd640 1 -- 172.21.15.63:0/2913630794 --> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc18081660 con 0x7fdc1807eb40 2024-09-21T07:01:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.199+0000 7fdc26ffd640 1 -- 172.21.15.63:0/2913630794 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fdc280a2050 con 0x7fdc340b6660 2024-09-21T07:01:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.200+0000 7fdc3ad8e640 1 --2- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] conn(0x7fdc1807eb40 0x7fdc18080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.200+0000 7fdc39d8c640 1 --2- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdc18078b90 0x7fdc1807b0a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdc34151840 tx=0x7fdc30009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.200+0000 7fdc3ad8e640 1 --2- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] conn(0x7fdc1807eb40 0x7fdc18080f90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:36.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.201+0000 7fdc26ffd640 1 -- 172.21.15.63:0/2913630794 <== osd.4 v2:172.21.15.71:6802/3275296788 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc18081660 con 0x7fdc1807eb40 2024-09-21T07:01:36.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.214+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2913630794 --> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdc340d3150 con 0x7fdc1807eb40 2024-09-21T07:01:36.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.214+0000 7fdc26ffd640 1 -- 172.21.15.63:0/2913630794 <== osd.4 v2:172.21.15.71:6802/3275296788 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdc340d3150 con 0x7fdc1807eb40 2024-09-21T07:01:36.216 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T07:01:36.216 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:01:36.216 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T07:01:36.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.215+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] conn(0x7fdc1807eb40 msgr2=0x7fdc18080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.215+0000 7fdc3c7f1640 1 --2- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:6802/3275296788,v1:172.21.15.71:6803/3275296788] conn(0x7fdc1807eb40 0x7fdc18080f90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.215+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdc18078b90 msgr2=0x7fdc1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.215+0000 7fdc3c7f1640 1 --2- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fdc18078b90 0x7fdc1807b0a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdc34151840 tx=0x7fdc30009040 comp rx=0 tx=0).stop 2024-09-21T07:01:36.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.215+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc340b6660 msgr2=0x7fdc340caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.215+0000 7fdc3c7f1640 1 --2- 172.21.15.63:0/2913630794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc340b6660 0x7fdc340caa70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800ea20 tx=0x7fdc2800eee0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.215+0000 7fdc3ad8e640 1 -- 172.21.15.63:0/2913630794 reap_dead start 2024-09-21T07:01:36.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.215+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2913630794 shutdown_connections 2024-09-21T07:01:36.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.215+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2913630794 >> 172.21.15.63:0/2913630794 conn(0x7fdc340d46a0 msgr2=0x7fdc34161b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:36.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.215+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2913630794 shutdown_connections 2024-09-21T07:01:36.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.215+0000 7fdc3c7f1640 1 -- 172.21.15.63:0/2913630794 wait complete. 2024-09-21T07:01:36.227 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-21T07:01:36.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.342+0000 7f795842e640 1 -- 172.21.15.63:0/2147959738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79500b6ca0 msgr2=0x7f79500b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.342+0000 7f795842e640 1 --2- 172.21.15.63:0/2147959738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79500b6ca0 0x7f79500b6730 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f79500b27d0 tx=0x7f794c02a380 comp rx=0 tx=0).stop 2024-09-21T07:01:36.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.342+0000 7f795842e640 1 -- 172.21.15.63:0/2147959738 shutdown_connections 2024-09-21T07:01:36.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.342+0000 7f795842e640 1 --2- 172.21.15.63:0/2147959738 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79500b6ca0 0x7f79500b6730 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.342+0000 7f795842e640 1 -- 172.21.15.63:0/2147959738 >> 172.21.15.63:0/2147959738 conn(0x7f79500b2f70 msgr2=0x7f79500b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:36.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.343+0000 7f795842e640 1 -- 172.21.15.63:0/2147959738 shutdown_connections 2024-09-21T07:01:36.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.343+0000 7f795842e640 1 -- 172.21.15.63:0/2147959738 wait complete. 2024-09-21T07:01:36.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.344+0000 7f795842e640 1 Processor -- start 2024-09-21T07:01:36.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.344+0000 7f795842e640 1 -- start start 2024-09-21T07:01:36.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f795842e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79500b6ca0 0x7f79501494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f795842e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79500d0af0 0x7f795014a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f795842e640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f795015c9a0 0x7f795014ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f795842e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f79500aecf0 con 0x7f79500d0af0 2024-09-21T07:01:36.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f795842e640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f79500aeb70 con 0x7f79500b6ca0 2024-09-21T07:01:36.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f795842e640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f79500aee70 con 0x7f795015c9a0 2024-09-21T07:01:36.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f79559c9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79500d0af0 0x7f795014a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f79559c9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79500d0af0 0x7f795014a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42778/0 (socket says 172.21.15.63:42778) 2024-09-21T07:01:36.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f79559c9640 1 -- 172.21.15.63:0/2637293478 learned_addr learned my addr 172.21.15.63:0/2637293478 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f79561ca640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79500b6ca0 0x7f79501494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f79559c9640 1 -- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f795015c9a0 msgr2=0x7f795014ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f79569cb640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f795015c9a0 0x7f795014ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f79559c9640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f795015c9a0 0x7f795014ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f79559c9640 1 -- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79500b6ca0 msgr2=0x7f79501494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f79559c9640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79500b6ca0 0x7f79501494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f79559c9640 1 -- 172.21.15.63:0/2637293478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7950149a30 con 0x7f79500d0af0 2024-09-21T07:01:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f79561ca640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79500b6ca0 0x7f79501494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:01:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f79559c9640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79500d0af0 0x7f795014a930 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f794000c730 tx=0x7f794000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.346+0000 7f7946ffd640 1 -- 172.21.15.63:0/2637293478 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940017070 con 0x7f79500d0af0 2024-09-21T07:01:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.347+0000 7f7946ffd640 1 -- 172.21.15.63:0/2637293478 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f794000ce40 con 0x7f79500d0af0 2024-09-21T07:01:36.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.347+0000 7f795842e640 1 -- 172.21.15.63:0/2637293478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795015f7e0 con 0x7f79500d0af0 2024-09-21T07:01:36.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.347+0000 7f7946ffd640 1 -- 172.21.15.63:0/2637293478 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794000a8a0 con 0x7f79500d0af0 2024-09-21T07:01:36.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.347+0000 7f795842e640 1 -- 172.21.15.63:0/2637293478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795014a130 con 0x7f79500d0af0 2024-09-21T07:01:36.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.347+0000 7f795842e640 1 -- 172.21.15.63:0/2637293478 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f795015fac0 con 0x7f79500d0af0 2024-09-21T07:01:36.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.348+0000 7f7946ffd640 1 -- 172.21.15.63:0/2637293478 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f794001a070 con 0x7f79500d0af0 2024-09-21T07:01:36.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.349+0000 7f7946ffd640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7934078b90 0x7f793407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.349+0000 7f7946ffd640 1 -- 172.21.15.63:0/2637293478 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f794009a0c0 con 0x7f79500d0af0 2024-09-21T07:01:36.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.349+0000 7f79561ca640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7934078b90 0x7f793407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.350+0000 7f79561ca640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7934078b90 0x7f793407b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f794c034000 tx=0x7f794c004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:36.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.353+0000 7f7946ffd640 1 -- 172.21.15.63:0/2637293478 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f79500b3e30 con 0x7f79500d0af0 2024-09-21T07:01:36.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.542+0000 7f795842e640 1 -- 172.21.15.63:0/2637293478 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f795015f570 con 0x7f7934078b90 2024-09-21T07:01:36.544 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.543+0000 7f7946ffd640 1 -- 172.21.15.63:0/2637293478 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f795015f570 con 0x7f7934078b90 2024-09-21T07:01:36.544 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 4 to deep-scrub 2024-09-21T07:01:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.545+0000 7f795842e640 1 -- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7934078b90 msgr2=0x7f793407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.545+0000 7f795842e640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7934078b90 0x7f793407b0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f794c034000 tx=0x7f794c004730 comp rx=0 tx=0).stop 2024-09-21T07:01:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.545+0000 7f795842e640 1 -- 172.21.15.63:0/2637293478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79500d0af0 msgr2=0x7f795014a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.545+0000 7f795842e640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79500d0af0 0x7f795014a930 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f794000c730 tx=0x7f794000cbf0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.545+0000 7f795842e640 1 -- 172.21.15.63:0/2637293478 shutdown_connections 2024-09-21T07:01:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.545+0000 7f795842e640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f7934078b90 0x7f793407b0a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.545+0000 7f795842e640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f795015c9a0 0x7f795014ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.545+0000 7f795842e640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f79500d0af0 0x7f795014a930 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.545+0000 7f795842e640 1 --2- 172.21.15.63:0/2637293478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f79500b6ca0 0x7f79501494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.545+0000 7f795842e640 1 -- 172.21.15.63:0/2637293478 >> 172.21.15.63:0/2637293478 conn(0x7f79500b2f70 msgr2=0x7f7950159610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.545+0000 7f795842e640 1 -- 172.21.15.63:0/2637293478 shutdown_connections 2024-09-21T07:01:36.547 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.545+0000 7f795842e640 1 -- 172.21.15.63:0/2637293478 wait complete. 2024-09-21T07:01:36.557 INFO:tasks.ceph:Scrubbing osd.5 2024-09-21T07:01:36.558 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:01:36.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.677+0000 7f6b74789640 1 -- 172.21.15.63:0/1896557227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b6c0ceaf0 msgr2=0x7f6b6c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.677+0000 7f6b74789640 1 --2- 172.21.15.63:0/1896557227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b6c0ceaf0 0x7f6b6c0d0270 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009bb0 tx=0x7f6b5c02a780 comp rx=0 tx=0).stop 2024-09-21T07:01:36.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.677+0000 7f6b74789640 1 -- 172.21.15.63:0/1896557227 shutdown_connections 2024-09-21T07:01:36.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.677+0000 7f6b74789640 1 --2- 172.21.15.63:0/1896557227 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b6c0b2fc0 0x7f6b6c0cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.677+0000 7f6b74789640 1 --2- 172.21.15.63:0/1896557227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b6c0ceaf0 0x7f6b6c0d0270 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.677+0000 7f6b74789640 1 -- 172.21.15.63:0/1896557227 >> 172.21.15.63:0/1896557227 conn(0x7f6b6c0cef40 msgr2=0x7f6b6c0cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:36.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.677+0000 7f6b74789640 1 -- 172.21.15.63:0/1896557227 shutdown_connections 2024-09-21T07:01:36.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.677+0000 7f6b74789640 1 -- 172.21.15.63:0/1896557227 wait complete. 2024-09-21T07:01:36.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.679+0000 7f6b74789640 1 Processor -- start 2024-09-21T07:01:36.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.679+0000 7f6b74789640 1 -- start start 2024-09-21T07:01:36.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.680+0000 7f6b74789640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b6c0b2fc0 0x7f6b6c09c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.680+0000 7f6b74789640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b6c0ceaf0 0x7f6b6c09e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.680+0000 7f6b74789640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b6c0d07b0 0x7f6b6c160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.680+0000 7f6b74789640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c0cdc90 con 0x7f6b6c0b2fc0 2024-09-21T07:01:36.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.680+0000 7f6b74789640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c0cde10 con 0x7f6b6c0ceaf0 2024-09-21T07:01:36.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.680+0000 7f6b74789640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f6b6c167190 con 0x7f6b6c0d07b0 2024-09-21T07:01:36.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.680+0000 7f6b72525640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b6c0b2fc0 0x7f6b6c09c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.680+0000 7f6b72525640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b6c0b2fc0 0x7f6b6c09c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42786/0 (socket says 172.21.15.63:42786) 2024-09-21T07:01:36.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.680+0000 7f6b72525640 1 -- 172.21.15.63:0/4273877430 learned_addr learned my addr 172.21.15.63:0/4273877430 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:36.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.680+0000 7f6b72d26640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b6c0d07b0 0x7f6b6c160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.680+0000 7f6b71d24640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b6c0ceaf0 0x7f6b6c09e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.680+0000 7f6b72525640 1 -- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b6c0d07b0 msgr2=0x7f6b6c160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.680+0000 7f6b72525640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f6b6c0d07b0 0x7f6b6c160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.681+0000 7f6b72525640 1 -- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b6c0ceaf0 msgr2=0x7f6b6c09e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.681+0000 7f6b72525640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6b6c0ceaf0 0x7f6b6c09e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.681+0000 7f6b72525640 1 -- 172.21.15.63:0/4273877430 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6c09ef30 con 0x7f6b6c0b2fc0 2024-09-21T07:01:36.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.681+0000 7f6b72525640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b6c0b2fc0 0x7f6b6c09c7d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009cd0 tx=0x7f6b5c004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:36.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.681+0000 7f6b6affd640 1 -- 172.21.15.63:0/4273877430 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c040020 con 0x7f6b6c0b2fc0 2024-09-21T07:01:36.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.681+0000 7f6b6affd640 1 -- 172.21.15.63:0/4273877430 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b5c03c750 con 0x7f6b6c0b2fc0 2024-09-21T07:01:36.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.681+0000 7f6b6affd640 1 -- 172.21.15.63:0/4273877430 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c03cba0 con 0x7f6b6c0b2fc0 2024-09-21T07:01:36.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.681+0000 7f6b74789640 1 -- 172.21.15.63:0/4273877430 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6c09d020 con 0x7f6b6c0b2fc0 2024-09-21T07:01:36.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.681+0000 7f6b74789640 1 -- 172.21.15.63:0/4273877430 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6c160380 con 0x7f6b6c0b2fc0 2024-09-21T07:01:36.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.682+0000 7f6b74789640 1 -- 172.21.15.63:0/4273877430 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b6c0d0270 con 0x7f6b6c0b2fc0 2024-09-21T07:01:36.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.683+0000 7f6b6affd640 1 -- 172.21.15.63:0/4273877430 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b5c043020 con 0x7f6b6c0b2fc0 2024-09-21T07:01:36.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.683+0000 7f6b6affd640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6b58078b90 0x7f6b5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.683+0000 7f6b6affd640 1 -- 172.21.15.63:0/4273877430 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f6b5c0bbd60 con 0x7f6b6c0b2fc0 2024-09-21T07:01:36.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.684+0000 7f6b71d24640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6b58078b90 0x7f6b5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.684+0000 7f6b6affd640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] conn(0x7f6b5807eb40 0x7f6b58080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.684+0000 7f6b6affd640 1 -- 172.21.15.63:0/4273877430 --> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b5c046e50 con 0x7f6b5807eb40 2024-09-21T07:01:36.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.684+0000 7f6b6affd640 1 -- 172.21.15.63:0/4273877430 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f6b5c0bc1f0 con 0x7f6b6c0b2fc0 2024-09-21T07:01:36.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.684+0000 7f6b72d26640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] conn(0x7f6b5807eb40 0x7f6b58080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.684+0000 7f6b71d24640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6b58078b90 0x7f6b5807b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6b60007fd0 tx=0x7f6b60001370 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:36.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.684+0000 7f6b72d26640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] conn(0x7f6b5807eb40 0x7f6b58080f90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:36.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.685+0000 7f6b6affd640 1 -- 172.21.15.63:0/4273877430 <== osd.5 v2:172.21.15.71:6819/3896443315 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b5c046e50 con 0x7f6b5807eb40 2024-09-21T07:01:36.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.697+0000 7f6b74789640 1 -- 172.21.15.63:0/4273877430 --> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6b6c0b8380 con 0x7f6b5807eb40 2024-09-21T07:01:36.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.698+0000 7f6b6affd640 1 -- 172.21.15.63:0/4273877430 <== osd.5 v2:172.21.15.71:6819/3896443315 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6b6c0b8380 con 0x7f6b5807eb40 2024-09-21T07:01:36.700 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T07:01:36.700 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:01:36.700 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T07:01:36.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.698+0000 7f6b74789640 1 -- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] conn(0x7f6b5807eb40 msgr2=0x7f6b58080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.698+0000 7f6b74789640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:6819/3896443315,v1:172.21.15.71:6820/3896443315] conn(0x7f6b5807eb40 0x7f6b58080f90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.698+0000 7f6b74789640 1 -- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6b58078b90 msgr2=0x7f6b5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.698+0000 7f6b74789640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f6b58078b90 0x7f6b5807b0a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6b60007fd0 tx=0x7f6b60001370 comp rx=0 tx=0).stop 2024-09-21T07:01:36.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.698+0000 7f6b74789640 1 -- 172.21.15.63:0/4273877430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b6c0b2fc0 msgr2=0x7f6b6c09c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.698+0000 7f6b74789640 1 --2- 172.21.15.63:0/4273877430 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6b6c0b2fc0 0x7f6b6c09c7d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009cd0 tx=0x7f6b5c004420 comp rx=0 tx=0).stop 2024-09-21T07:01:36.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.698+0000 7f6b72d26640 1 -- 172.21.15.63:0/4273877430 reap_dead start 2024-09-21T07:01:36.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.698+0000 7f6b74789640 1 -- 172.21.15.63:0/4273877430 shutdown_connections 2024-09-21T07:01:36.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.698+0000 7f6b74789640 1 -- 172.21.15.63:0/4273877430 >> 172.21.15.63:0/4273877430 conn(0x7f6b6c0cef40 msgr2=0x7f6b6c0b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:36.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.698+0000 7f6b74789640 1 -- 172.21.15.63:0/4273877430 shutdown_connections 2024-09-21T07:01:36.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.698+0000 7f6b74789640 1 -- 172.21.15.63:0/4273877430 wait complete. 2024-09-21T07:01:36.711 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-21T07:01:36.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.826+0000 7f92c8e69640 1 -- 172.21.15.63:0/3739923570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b0005390 msgr2=0x7f92b000ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.826+0000 7f92c8e69640 1 --2- 172.21.15.63:0/3739923570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b0005390 0x7f92b000ba20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f92bc001800 tx=0x7f92b0005830 comp rx=0 tx=0).stop 2024-09-21T07:01:36.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.826+0000 7f92c8e69640 1 -- 172.21.15.63:0/3739923570 shutdown_connections 2024-09-21T07:01:36.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.826+0000 7f92c8e69640 1 --2- 172.21.15.63:0/3739923570 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b0005390 0x7f92b000ba20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.826+0000 7f92c8e69640 1 -- 172.21.15.63:0/3739923570 >> 172.21.15.63:0/3739923570 conn(0x7f92c40b2f70 msgr2=0x7f92c40b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.826+0000 7f92c8e69640 1 -- 172.21.15.63:0/3739923570 shutdown_connections 2024-09-21T07:01:36.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.826+0000 7f92c8e69640 1 -- 172.21.15.63:0/3739923570 wait complete. 2024-09-21T07:01:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.828+0000 7f92c8e69640 1 Processor -- start 2024-09-21T07:01:36.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.828+0000 7f92c8e69640 1 -- start start 2024-09-21T07:01:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.829+0000 7f92c8e69640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92b0005390 0x7f92c409e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.829+0000 7f92c8e69640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92c41f58b0 0x7f92c41f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.829+0000 7f92c8e69640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92c414b510 0x7f92c414b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.829+0000 7f92c8e69640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f92c40d0620 con 0x7f92c41f58b0 2024-09-21T07:01:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.829+0000 7f92c8e69640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f92c40d04a0 con 0x7f92b0005390 2024-09-21T07:01:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c8e69640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f92c40b5c90 con 0x7f92c414b510 2024-09-21T07:01:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92c41f58b0 0x7f92c41f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c1d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92c41f58b0 0x7f92c41f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42812/0 (socket says 172.21.15.63:42812) 2024-09-21T07:01:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c1d9b640 1 -- 172.21.15.63:0/1729608345 learned_addr learned my addr 172.21.15.63:0/1729608345 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c259c640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92b0005390 0x7f92c409e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c2d9d640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92c414b510 0x7f92c414b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c1d9b640 1 -- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92c414b510 msgr2=0x7f92c414b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c1d9b640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92c414b510 0x7f92c414b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c1d9b640 1 -- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92b0005390 msgr2=0x7f92c409e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:36.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c1d9b640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92b0005390 0x7f92c409e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c1d9b640 1 -- 172.21.15.63:0/1729608345 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c41f6200 con 0x7f92c41f58b0 2024-09-21T07:01:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c1d9b640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92c41f58b0 0x7f92c41f5cc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f92ac003850 tx=0x7f92ac003d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92baffd640 1 -- 172.21.15.63:0/1729608345 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac003e40 con 0x7f92c41f58b0 2024-09-21T07:01:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92baffd640 1 -- 172.21.15.63:0/1729608345 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92ac018020 con 0x7f92c41f58b0 2024-09-21T07:01:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c8e69640 1 -- 172.21.15.63:0/1729608345 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c41e5290 con 0x7f92c41f58b0 2024-09-21T07:01:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92baffd640 1 -- 172.21.15.63:0/1729608345 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac011dc0 con 0x7f92c41f58b0 2024-09-21T07:01:36.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.830+0000 7f92c8e69640 1 -- 172.21.15.63:0/1729608345 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c41e5a70 con 0x7f92c41f58b0 2024-09-21T07:01:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.831+0000 7f92c8e69640 1 -- 172.21.15.63:0/1729608345 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c40b61f0 con 0x7f92c41f58b0 2024-09-21T07:01:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.832+0000 7f92baffd640 1 -- 172.21.15.63:0/1729608345 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f92ac013450 con 0x7f92c41f58b0 2024-09-21T07:01:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.833+0000 7f92baffd640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f92a4078bc0 0x7f92a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.833+0000 7f92baffd640 1 -- 172.21.15.63:0/1729608345 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f92ac09daf0 con 0x7f92c41f58b0 2024-09-21T07:01:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.833+0000 7f92c259c640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f92a4078bc0 0x7f92a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:36.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.833+0000 7f92c259c640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f92a4078bc0 0x7f92a407b0d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f92b40097f0 tx=0x7f92b4009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:36.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:36.837+0000 7f92baffd640 1 -- 172.21.15.63:0/1729608345 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f92ac022020 con 0x7f92c41f58b0 2024-09-21T07:01:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.025+0000 7f92c8e69640 1 -- 172.21.15.63:0/1729608345 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f92c4070ca0 con 0x7f92a4078bc0 2024-09-21T07:01:37.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.025+0000 7f92baffd640 1 -- 172.21.15.63:0/1729608345 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f92c4070ca0 con 0x7f92a4078bc0 2024-09-21T07:01:37.027 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 5 to deep-scrub 2024-09-21T07:01:37.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.027+0000 7f92c8e69640 1 -- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f92a4078bc0 msgr2=0x7f92a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.027+0000 7f92c8e69640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f92a4078bc0 0x7f92a407b0d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f92b40097f0 tx=0x7f92b4009500 comp rx=0 tx=0).stop 2024-09-21T07:01:37.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.027+0000 7f92c8e69640 1 -- 172.21.15.63:0/1729608345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92c41f58b0 msgr2=0x7f92c41f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.027+0000 7f92c8e69640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92c41f58b0 0x7f92c41f5cc0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f92ac003850 tx=0x7f92ac003d10 comp rx=0 tx=0).stop 2024-09-21T07:01:37.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.028+0000 7f92c8e69640 1 -- 172.21.15.63:0/1729608345 shutdown_connections 2024-09-21T07:01:37.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.028+0000 7f92c8e69640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f92a4078bc0 0x7f92a407b0d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.028+0000 7f92c8e69640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f92c414b510 0x7f92c414b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.028+0000 7f92c8e69640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92c41f58b0 0x7f92c41f5cc0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.028+0000 7f92c8e69640 1 --2- 172.21.15.63:0/1729608345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92b0005390 0x7f92c409e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.028+0000 7f92c8e69640 1 -- 172.21.15.63:0/1729608345 >> 172.21.15.63:0/1729608345 conn(0x7f92c40b2f70 msgr2=0x7f92c415b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:37.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.028+0000 7f92c8e69640 1 -- 172.21.15.63:0/1729608345 shutdown_connections 2024-09-21T07:01:37.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.028+0000 7f92c8e69640 1 -- 172.21.15.63:0/1729608345 wait complete. 2024-09-21T07:01:37.040 INFO:tasks.ceph:Scrubbing osd.6 2024-09-21T07:01:37.040 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:01:37.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.159+0000 7fc8271c3640 1 -- 172.21.15.63:0/1701216003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc808004e30 msgr2=0x7fc80800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.159+0000 7fc8271c3640 1 --2- 172.21.15.63:0/1701216003 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc808004e30 0x7fc80800b9c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc82008dac0 tx=0x7fc808005830 comp rx=0 tx=0).stop 2024-09-21T07:01:37.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.159+0000 7fc825760640 1 -- 172.21.15.63:0/1701216003 reap_dead start 2024-09-21T07:01:37.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.160+0000 7fc8271c3640 1 -- 172.21.15.63:0/1701216003 shutdown_connections 2024-09-21T07:01:37.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.160+0000 7fc8271c3640 1 -- 172.21.15.63:0/1701216003 >> 172.21.15.63:0/1701216003 conn(0x7fc8200d4680 msgr2=0x7fc8200d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:37.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.160+0000 7fc8271c3640 1 -- 172.21.15.63:0/1701216003 shutdown_connections 2024-09-21T07:01:37.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.160+0000 7fc8271c3640 1 -- 172.21.15.63:0/1701216003 wait complete. 2024-09-21T07:01:37.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.161+0000 7fc8271c3640 1 Processor -- start 2024-09-21T07:01:37.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.161+0000 7fc8271c3640 1 -- start start 2024-09-21T07:01:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc8271c3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc808004e30 0x7fc820151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc8271c3640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc82009e9f0 0x7fc82009ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc8271c3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8200a0650 0x7fc8200a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc8271c3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc8200d1f40 con 0x7fc8200a0650 2024-09-21T07:01:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc8271c3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc8200d1dc0 con 0x7fc808004e30 2024-09-21T07:01:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc8271c3640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fc8200b9c40 con 0x7fc82009e9f0 2024-09-21T07:01:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc825760640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8200a0650 0x7fc8200a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc825760640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8200a0650 0x7fc8200a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42820/0 (socket says 172.21.15.63:42820) 2024-09-21T07:01:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc825760640 1 -- 172.21.15.63:0/3824505951 learned_addr learned my addr 172.21.15.63:0/3824505951 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc81ffff640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc82009e9f0 0x7fc82009ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc824f5f640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc808004e30 0x7fc820151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc825760640 1 -- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc82009e9f0 msgr2=0x7fc82009ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc825760640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fc82009e9f0 0x7fc82009ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc825760640 1 -- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc808004e30 msgr2=0x7fc820151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc825760640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc808004e30 0x7fc820151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.163+0000 7fc825760640 1 -- 172.21.15.63:0/3824505951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc820152250 con 0x7fc8200a0650 2024-09-21T07:01:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.164+0000 7fc825760640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8200a0650 0x7fc8200a0a60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc81802ad90 tx=0x7fc818001be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.164+0000 7fc81d7fa640 1 -- 172.21.15.63:0/3824505951 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818037030 con 0x7fc8200a0650 2024-09-21T07:01:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.164+0000 7fc81d7fa640 1 -- 172.21.15.63:0/3824505951 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc818003d40 con 0x7fc8200a0650 2024-09-21T07:01:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.164+0000 7fc8271c3640 1 -- 172.21.15.63:0/3824505951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82009f5b0 con 0x7fc8200a0650 2024-09-21T07:01:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.164+0000 7fc81d7fa640 1 -- 172.21.15.63:0/3824505951 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818006c40 con 0x7fc8200a0650 2024-09-21T07:01:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.164+0000 7fc8271c3640 1 -- 172.21.15.63:0/3824505951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc82009fb70 con 0x7fc8200a0650 2024-09-21T07:01:37.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.165+0000 7fc8271c3640 1 -- 172.21.15.63:0/3824505951 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8201608a0 con 0x7fc8200a0650 2024-09-21T07:01:37.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.166+0000 7fc81d7fa640 1 -- 172.21.15.63:0/3824505951 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc818006500 con 0x7fc8200a0650 2024-09-21T07:01:37.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.166+0000 7fc81d7fa640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc80c078bc0 0x7fc80c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.166+0000 7fc81d7fa640 1 -- 172.21.15.63:0/3824505951 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7fc8180bad40 con 0x7fc8200a0650 2024-09-21T07:01:37.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.166+0000 7fc81d7fa640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] conn(0x7fc80c07eb70 0x7fc80c080fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.166+0000 7fc81d7fa640 1 -- 172.21.15.63:0/3824505951 --> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc818003b90 con 0x7fc80c07eb70 2024-09-21T07:01:37.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.166+0000 7fc81d7fa640 1 -- 172.21.15.63:0/3824505951 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc8180bb1d0 con 0x7fc8200a0650 2024-09-21T07:01:37.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.167+0000 7fc824f5f640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc80c078bc0 0x7fc80c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.167+0000 7fc81ffff640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] conn(0x7fc80c07eb70 0x7fc80c080fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.167+0000 7fc824f5f640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc80c078bc0 0x7fc80c07b0d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc8200d08a0 tx=0x7fc810005f30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:37.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.167+0000 7fc81ffff640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] conn(0x7fc80c07eb70 0x7fc80c080fc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:37.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.168+0000 7fc81d7fa640 1 -- 172.21.15.63:0/3824505951 <== osd.6 v2:172.21.15.71:6810/3022228131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc818003b90 con 0x7fc80c07eb70 2024-09-21T07:01:37.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.180+0000 7fc8271c3640 1 -- 172.21.15.63:0/3824505951 --> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc82009f360 con 0x7fc80c07eb70 2024-09-21T07:01:37.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.181+0000 7fc81d7fa640 1 -- 172.21.15.63:0/3824505951 <== osd.6 v2:172.21.15.71:6810/3022228131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc82009f360 con 0x7fc80c07eb70 2024-09-21T07:01:37.183 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T07:01:37.183 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:01:37.183 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T07:01:37.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.181+0000 7fc8271c3640 1 -- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] conn(0x7fc80c07eb70 msgr2=0x7fc80c080fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.181+0000 7fc8271c3640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:6810/3022228131,v1:172.21.15.71:6811/3022228131] conn(0x7fc80c07eb70 0x7fc80c080fc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.181+0000 7fc8271c3640 1 -- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc80c078bc0 msgr2=0x7fc80c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.181+0000 7fc8271c3640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fc80c078bc0 0x7fc80c07b0d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc8200d08a0 tx=0x7fc810005f30 comp rx=0 tx=0).stop 2024-09-21T07:01:37.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.181+0000 7fc8271c3640 1 -- 172.21.15.63:0/3824505951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8200a0650 msgr2=0x7fc8200a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.181+0000 7fc8271c3640 1 --2- 172.21.15.63:0/3824505951 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc8200a0650 0x7fc8200a0a60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc81802ad90 tx=0x7fc818001be0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.181+0000 7fc825760640 1 -- 172.21.15.63:0/3824505951 reap_dead start 2024-09-21T07:01:37.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.181+0000 7fc8271c3640 1 -- 172.21.15.63:0/3824505951 shutdown_connections 2024-09-21T07:01:37.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.181+0000 7fc8271c3640 1 -- 172.21.15.63:0/3824505951 >> 172.21.15.63:0/3824505951 conn(0x7fc8200d4680 msgr2=0x7fc8200b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:37.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.181+0000 7fc8271c3640 1 -- 172.21.15.63:0/3824505951 shutdown_connections 2024-09-21T07:01:37.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.181+0000 7fc8271c3640 1 -- 172.21.15.63:0/3824505951 wait complete. 2024-09-21T07:01:37.193 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-21T07:01:37.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.309+0000 7fb609684640 1 -- 172.21.15.63:0/3285127425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb60409af80 msgr2=0x7fb6040cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.309+0000 7fb609684640 1 --2- 172.21.15.63:0/3285127425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb60409af80 0x7fb6040cdd30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009830 tx=0x7fb5fc02a560 comp rx=0 tx=0).stop 2024-09-21T07:01:37.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.309+0000 7fb609684640 1 -- 172.21.15.63:0/3285127425 shutdown_connections 2024-09-21T07:01:37.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.309+0000 7fb609684640 1 --2- 172.21.15.63:0/3285127425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb60409af80 0x7fb6040cdd30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.309+0000 7fb609684640 1 --2- 172.21.15.63:0/3285127425 >> v2:172.21.15.71:3300/0 conn(0x7fb6040b3750 0x7fb60409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.309+0000 7fb609684640 1 -- 172.21.15.63:0/3285127425 >> 172.21.15.63:0/3285127425 conn(0x7fb6040b3fb0 msgr2=0x7fb6040b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:37.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.309+0000 7fb609684640 1 -- 172.21.15.63:0/3285127425 shutdown_connections 2024-09-21T07:01:37.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.309+0000 7fb609684640 1 -- 172.21.15.63:0/3285127425 wait complete. 2024-09-21T07:01:37.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.311+0000 7fb609684640 1 Processor -- start 2024-09-21T07:01:37.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.311+0000 7fb609684640 1 -- start start 2024-09-21T07:01:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.312+0000 7fb609684640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb60409af80 0x7fb6041f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.312+0000 7fb609684640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6040b3750 0x7fb60415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.312+0000 7fb609684640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6040b3b60 0x7fb604149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.312+0000 7fb609684640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb6040b6ac0 con 0x7fb6040b3b60 2024-09-21T07:01:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.312+0000 7fb609684640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb6040b6940 con 0x7fb60409af80 2024-09-21T07:01:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.312+0000 7fb609684640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fb6040b6c40 con 0x7fb6040b3750 2024-09-21T07:01:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.312+0000 7fb6037fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6040b3b60 0x7fb604149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.312+0000 7fb6037fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6040b3b60 0x7fb604149ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42830/0 (socket says 172.21.15.63:42830) 2024-09-21T07:01:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.312+0000 7fb6037fe640 1 -- 172.21.15.63:0/2474006159 learned_addr learned my addr 172.21.15.63:0/2474006159 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.312+0000 7fb602ffd640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb60409af80 0x7fb6041f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.312+0000 7fb6027fc640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6040b3750 0x7fb60415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.313+0000 7fb6037fe640 1 -- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6040b3750 msgr2=0x7fb60415e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.313+0000 7fb6037fe640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6040b3750 0x7fb60415e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.313+0000 7fb6037fe640 1 -- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb60409af80 msgr2=0x7fb6041f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.313+0000 7fb6037fe640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb60409af80 0x7fb6041f75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.313+0000 7fb6037fe640 1 -- 172.21.15.63:0/2474006159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6041f7b30 con 0x7fb6040b3b60 2024-09-21T07:01:37.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.313+0000 7fb6037fe640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6040b3b60 0x7fb604149ff0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc02ab50 tx=0x7fb5fc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:37.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.313+0000 7fb5fb7fe640 1 -- 172.21.15.63:0/2474006159 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc005c90 con 0x7fb6040b3b60 2024-09-21T07:01:37.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.313+0000 7fb5fb7fe640 1 -- 172.21.15.63:0/2474006159 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5fc031e50 con 0x7fb6040b3b60 2024-09-21T07:01:37.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.313+0000 7fb5fb7fe640 1 -- 172.21.15.63:0/2474006159 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc005220 con 0x7fb6040b3b60 2024-09-21T07:01:37.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.313+0000 7fb609684640 1 -- 172.21.15.63:0/2474006159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60414d0c0 con 0x7fb6040b3b60 2024-09-21T07:01:37.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.313+0000 7fb609684640 1 -- 172.21.15.63:0/2474006159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb60414d680 con 0x7fb6040b3b60 2024-09-21T07:01:37.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.314+0000 7fb609684640 1 -- 172.21.15.63:0/2474006159 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6040b7180 con 0x7fb6040b3b60 2024-09-21T07:01:37.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.315+0000 7fb5fb7fe640 1 -- 172.21.15.63:0/2474006159 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb5fc0053c0 con 0x7fb6040b3b60 2024-09-21T07:01:37.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.315+0000 7fb5fb7fe640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb5e4078bc0 0x7fb5e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.315+0000 7fb5fb7fe640 1 -- 172.21.15.63:0/2474006159 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7fb5fc0bb990 con 0x7fb6040b3b60 2024-09-21T07:01:37.317 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.316+0000 7fb602ffd640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb5e4078bc0 0x7fb5e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.316+0000 7fb602ffd640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb5e4078bc0 0x7fb5e407b0d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4005fd0 tx=0x7fb5f4009500 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:37.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.320+0000 7fb5fb7fe640 1 -- 172.21.15.63:0/2474006159 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fb5fc03f030 con 0x7fb6040b3b60 2024-09-21T07:01:37.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.507+0000 7fb609684640 1 -- 172.21.15.63:0/2474006159 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb60409bb50 con 0x7fb5e4078bc0 2024-09-21T07:01:37.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.507+0000 7fb5fb7fe640 1 -- 172.21.15.63:0/2474006159 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb60409bb50 con 0x7fb5e4078bc0 2024-09-21T07:01:37.509 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 6 to deep-scrub 2024-09-21T07:01:37.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.510+0000 7fb609684640 1 -- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb5e4078bc0 msgr2=0x7fb5e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.510+0000 7fb609684640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb5e4078bc0 0x7fb5e407b0d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4005fd0 tx=0x7fb5f4009500 comp rx=0 tx=0).stop 2024-09-21T07:01:37.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.510+0000 7fb609684640 1 -- 172.21.15.63:0/2474006159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6040b3b60 msgr2=0x7fb604149ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.510+0000 7fb609684640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6040b3b60 0x7fb604149ff0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc02ab50 tx=0x7fb5fc033c20 comp rx=0 tx=0).stop 2024-09-21T07:01:37.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.510+0000 7fb609684640 1 -- 172.21.15.63:0/2474006159 shutdown_connections 2024-09-21T07:01:37.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.510+0000 7fb609684640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fb5e4078bc0 0x7fb5e407b0d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.510+0000 7fb609684640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb6040b3b60 0x7fb604149ff0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.510+0000 7fb609684640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fb6040b3750 0x7fb60415e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.510+0000 7fb609684640 1 --2- 172.21.15.63:0/2474006159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb60409af80 0x7fb6041f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.512 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.510+0000 7fb609684640 1 -- 172.21.15.63:0/2474006159 >> 172.21.15.63:0/2474006159 conn(0x7fb6040b3fb0 msgr2=0x7fb60409f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:37.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.510+0000 7fb609684640 1 -- 172.21.15.63:0/2474006159 shutdown_connections 2024-09-21T07:01:37.513 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.510+0000 7fb609684640 1 -- 172.21.15.63:0/2474006159 wait complete. 2024-09-21T07:01:37.523 INFO:tasks.ceph:Scrubbing osd.7 2024-09-21T07:01:37.523 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-21T07:01:37.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.641+0000 7f55c1ea9640 1 -- 172.21.15.63:0/3182851680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55bc0cddb0 msgr2=0x7f55bc0ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.641+0000 7f55c1ea9640 1 --2- 172.21.15.63:0/3182851680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55bc0cddb0 0x7f55bc0ce1c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f55bc073600 tx=0x7f55b002a530 comp rx=0 tx=0).stop 2024-09-21T07:01:37.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.641+0000 7f55c1ea9640 1 -- 172.21.15.63:0/3182851680 shutdown_connections 2024-09-21T07:01:37.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.641+0000 7f55c1ea9640 1 --2- 172.21.15.63:0/3182851680 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55bc0cddb0 0x7f55bc0ce1c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.641+0000 7f55c1ea9640 1 --2- 172.21.15.63:0/3182851680 >> v2:172.21.15.71:3300/0 conn(0x7f55bc0b6c00 0x7f55bc15edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.641+0000 7f55c1ea9640 1 -- 172.21.15.63:0/3182851680 >> 172.21.15.63:0/3182851680 conn(0x7f55bc0b2f70 msgr2=0x7f55bc0b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:37.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.641+0000 7f55c1ea9640 1 -- 172.21.15.63:0/3182851680 shutdown_connections 2024-09-21T07:01:37.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.642+0000 7f55c1ea9640 1 -- 172.21.15.63:0/3182851680 wait complete. 2024-09-21T07:01:37.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.643+0000 7f55c1ea9640 1 Processor -- start 2024-09-21T07:01:37.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.643+0000 7f55c1ea9640 1 -- start start 2024-09-21T07:01:37.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55c1ea9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55bc0b6c00 0x7f55bc1f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55c1ea9640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55bc0cbc80 0x7f55bc158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55c1ea9640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc0cddb0 0x7f55bc15d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55c1ea9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc0cfec0 con 0x7f55bc0b6c00 2024-09-21T07:01:37.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55c1ea9640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc0c8290 con 0x7f55bc0cddb0 2024-09-21T07:01:37.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55c1ea9640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f55bc0d0040 con 0x7f55bc0cbc80 2024-09-21T07:01:37.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55bb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55bc0b6c00 0x7f55bc1f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55bb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55bc0b6c00 0x7f55bc1f4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42848/0 (socket says 172.21.15.63:42848) 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55bb7fe640 1 -- 172.21.15.63:0/1785252480 learned_addr learned my addr 172.21.15.63:0/1785252480 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55baffd640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55bc0cbc80 0x7f55bc158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55bbfff640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc0cddb0 0x7f55bc15d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55bb7fe640 1 -- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55bc0cbc80 msgr2=0x7f55bc158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55bb7fe640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f55bc0cbc80 0x7f55bc158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55bb7fe640 1 -- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc0cddb0 msgr2=0x7f55bc15d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55bb7fe640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc0cddb0 0x7f55bc15d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55bb7fe640 1 -- 172.21.15.63:0/1785252480 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc1f48d0 con 0x7f55bc0b6c00 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55bbfff640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc0cddb0 0x7f55bc15d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.645+0000 7f55bb7fe640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55bc0b6c00 0x7f55bc1f4390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00d740 tx=0x7f55ac00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.646+0000 7f55a3fff640 1 -- 172.21.15.63:0/1785252480 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac017070 con 0x7f55bc0b6c00 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.646+0000 7f55a3fff640 1 -- 172.21.15.63:0/1785252480 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55ac009d20 con 0x7f55bc0b6c00 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.646+0000 7f55a3fff640 1 -- 172.21.15.63:0/1785252480 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0106c0 con 0x7f55bc0b6c00 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.646+0000 7f55c1ea9640 1 -- 172.21.15.63:0/1785252480 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55bc148b60 con 0x7f55bc0b6c00 2024-09-21T07:01:37.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.646+0000 7f55c1ea9640 1 -- 172.21.15.63:0/1785252480 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55bc149120 con 0x7f55bc0b6c00 2024-09-21T07:01:37.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.647+0000 7f55c1ea9640 1 -- 172.21.15.63:0/1785252480 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f55bc1f6f80 con 0x7f55bc0b6c00 2024-09-21T07:01:37.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.647+0000 7f55a3fff640 1 -- 172.21.15.63:0/1785252480 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55ac01a070 con 0x7f55bc0b6c00 2024-09-21T07:01:37.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.648+0000 7f55a3fff640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f55a8078b90 0x7f55a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.648+0000 7f55a3fff640 1 -- 172.21.15.63:0/1785252480 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f55ac09abe0 con 0x7f55bc0b6c00 2024-09-21T07:01:37.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.648+0000 7f55baffd640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f55a8078b90 0x7f55a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.648+0000 7f55a3fff640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] conn(0x7f55a807eb40 0x7f55a8080f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.648+0000 7f55a3fff640 1 -- 172.21.15.63:0/1785252480 --> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55a8081660 con 0x7f55a807eb40 2024-09-21T07:01:37.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.648+0000 7f55a3fff640 1 -- 172.21.15.63:0/1785252480 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f55ac09d2e0 con 0x7f55bc0b6c00 2024-09-21T07:01:37.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.648+0000 7f55bbfff640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] conn(0x7f55a807eb40 0x7f55a8080f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.649+0000 7f55baffd640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f55a8078b90 0x7f55a807b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f55b0034000 tx=0x7f55b0004730 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:37.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.649+0000 7f55bbfff640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] conn(0x7f55a807eb40 0x7f55a8080f90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:37.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.650+0000 7f55a3fff640 1 -- 172.21.15.63:0/1785252480 <== osd.7 v2:172.21.15.71:6818/829212065 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f55a8081660 con 0x7f55a807eb40 2024-09-21T07:01:37.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.662+0000 7f55c1ea9640 1 -- 172.21.15.63:0/1785252480 --> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f55bc0cca20 con 0x7f55a807eb40 2024-09-21T07:01:37.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.663+0000 7f55a3fff640 1 -- 172.21.15.63:0/1785252480 <== osd.7 v2:172.21.15.71:6818/829212065 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f55bc0cca20 con 0x7f55a807eb40 2024-09-21T07:01:37.665 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-09-21T07:01:37.665 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T07:01:37.665 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-09-21T07:01:37.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.663+0000 7f55c1ea9640 1 -- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] conn(0x7f55a807eb40 msgr2=0x7f55a8080f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.663+0000 7f55c1ea9640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:6818/829212065,v1:172.21.15.71:6821/829212065] conn(0x7f55a807eb40 0x7f55a8080f90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.663+0000 7f55c1ea9640 1 -- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f55a8078b90 msgr2=0x7f55a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.663+0000 7f55c1ea9640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f55a8078b90 0x7f55a807b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f55b0034000 tx=0x7f55b0004730 comp rx=0 tx=0).stop 2024-09-21T07:01:37.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.663+0000 7f55c1ea9640 1 -- 172.21.15.63:0/1785252480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55bc0b6c00 msgr2=0x7f55bc1f4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.663+0000 7f55c1ea9640 1 --2- 172.21.15.63:0/1785252480 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55bc0b6c00 0x7f55bc1f4390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f55ac00d740 tx=0x7f55ac00dc00 comp rx=0 tx=0).stop 2024-09-21T07:01:37.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.663+0000 7f55bbfff640 1 -- 172.21.15.63:0/1785252480 reap_dead start 2024-09-21T07:01:37.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.663+0000 7f55c1ea9640 1 -- 172.21.15.63:0/1785252480 shutdown_connections 2024-09-21T07:01:37.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.663+0000 7f55c1ea9640 1 -- 172.21.15.63:0/1785252480 >> 172.21.15.63:0/1785252480 conn(0x7f55bc0b2f70 msgr2=0x7f55bc06cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:37.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.664+0000 7f55c1ea9640 1 -- 172.21.15.63:0/1785252480 shutdown_connections 2024-09-21T07:01:37.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.664+0000 7f55c1ea9640 1 -- 172.21.15.63:0/1785252480 wait complete. 2024-09-21T07:01:37.676 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-21T07:01:37.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.791+0000 7f3186616640 1 -- 172.21.15.63:0/2401430628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31800b52a0 msgr2=0x7f31800b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.791+0000 7f3186616640 1 --2- 172.21.15.63:0/2401430628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31800b52a0 0x7f31800b56b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3174009830 tx=0x7f317402a530 comp rx=0 tx=0).stop 2024-09-21T07:01:37.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.791+0000 7f3186616640 1 -- 172.21.15.63:0/2401430628 shutdown_connections 2024-09-21T07:01:37.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.791+0000 7f3186616640 1 --2- 172.21.15.63:0/2401430628 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31800b52a0 0x7f31800b56b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.791+0000 7f3186616640 1 -- 172.21.15.63:0/2401430628 >> 172.21.15.63:0/2401430628 conn(0x7f31800ceed0 msgr2=0x7f31800cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:37.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.791+0000 7f3186616640 1 -- 172.21.15.63:0/2401430628 shutdown_connections 2024-09-21T07:01:37.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.791+0000 7f3186616640 1 -- 172.21.15.63:0/2401430628 wait complete. 2024-09-21T07:01:37.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.793+0000 7f3186616640 1 Processor -- start 2024-09-21T07:01:37.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.793+0000 7f3186616640 1 -- start start 2024-09-21T07:01:37.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f3186616640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f31800b52a0 0x7f318014f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f3186616640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31800cd0b0 0x7f31800b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f3186616640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31800d0350 0x7f31800b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f3186616640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3180074610 con 0x7f31800cd0b0 2024-09-21T07:01:37.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f3186616640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f31800d1400 con 0x7f31800d0350 2024-09-21T07:01:37.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f3186616640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f31800b5bf0 con 0x7f31800b52a0 2024-09-21T07:01:37.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f317f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31800cd0b0 0x7f31800b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f317f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31800cd0b0 0x7f31800b0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42866/0 (socket says 172.21.15.63:42866) 2024-09-21T07:01:37.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f317f7fe640 1 -- 172.21.15.63:0/3957614278 learned_addr learned my addr 172.21.15.63:0/3957614278 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:37.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f317ffff640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f31800b52a0 0x7f318014f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f3184bb3640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31800d0350 0x7f31800b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f317f7fe640 1 -- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f31800b52a0 msgr2=0x7f318014f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f317f7fe640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f31800b52a0 0x7f318014f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f317f7fe640 1 -- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31800d0350 msgr2=0x7f31800b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f317f7fe640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31800d0350 0x7f31800b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f317f7fe640 1 -- 172.21.15.63:0/3957614278 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318014fe00 con 0x7f31800cd0b0 2024-09-21T07:01:37.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.795+0000 7f317f7fe640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31800cd0b0 0x7f31800b0270 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3174009950 tx=0x7f3174033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:37.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.796+0000 7f317cff9640 1 -- 172.21.15.63:0/3957614278 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174031b50 con 0x7f31800cd0b0 2024-09-21T07:01:37.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.796+0000 7f317cff9640 1 -- 172.21.15.63:0/3957614278 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3174031de0 con 0x7f31800cd0b0 2024-09-21T07:01:37.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.796+0000 7f3186616640 1 -- 172.21.15.63:0/3957614278 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31800ca910 con 0x7f31800cd0b0 2024-09-21T07:01:37.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.796+0000 7f317cff9640 1 -- 172.21.15.63:0/3957614278 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174005280 con 0x7f31800cd0b0 2024-09-21T07:01:37.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.796+0000 7f3186616640 1 -- 172.21.15.63:0/3957614278 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31800caed0 con 0x7f31800cd0b0 2024-09-21T07:01:37.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.797+0000 7f3186616640 1 -- 172.21.15.63:0/3957614278 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f318009bae0 con 0x7f31800cd0b0 2024-09-21T07:01:37.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.797+0000 7f317cff9640 1 -- 172.21.15.63:0/3957614278 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3174005420 con 0x7f31800cd0b0 2024-09-21T07:01:37.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.798+0000 7f317cff9640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f316c078b90 0x7f316c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:37.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.798+0000 7f317cff9640 1 -- 172.21.15.63:0/3957614278 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f31740bbb60 con 0x7f31800cd0b0 2024-09-21T07:01:37.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.798+0000 7f317ffff640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f316c078b90 0x7f316c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:37.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.799+0000 7f317ffff640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f316c078b90 0x7f316c07b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f318009bcc0 tx=0x7f3170009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:37.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.802+0000 7f317cff9640 1 -- 172.21.15.63:0/3957614278 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f318009bae0 con 0x7f31800cd0b0 2024-09-21T07:01:37.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.989+0000 7f3186616640 1 -- 172.21.15.63:0/3957614278 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f31800b75e0 con 0x7f316c078b90 2024-09-21T07:01:37.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.991+0000 7f317cff9640 1 -- 172.21.15.63:0/3957614278 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f31800b75e0 con 0x7f316c078b90 2024-09-21T07:01:37.992 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 7 to deep-scrub 2024-09-21T07:01:37.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.992+0000 7f3186616640 1 -- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f316c078b90 msgr2=0x7f316c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.992+0000 7f3186616640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f316c078b90 0x7f316c07b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f318009bcc0 tx=0x7f3170009040 comp rx=0 tx=0).stop 2024-09-21T07:01:37.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.992+0000 7f3186616640 1 -- 172.21.15.63:0/3957614278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31800cd0b0 msgr2=0x7f31800b0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:37.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.992+0000 7f3186616640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31800cd0b0 0x7f31800b0270 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3174009950 tx=0x7f3174033ba0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.992+0000 7f3186616640 1 -- 172.21.15.63:0/3957614278 shutdown_connections 2024-09-21T07:01:37.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.992+0000 7f3186616640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f316c078b90 0x7f316c07b0a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.992+0000 7f3186616640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31800d0350 0x7f31800b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.992+0000 7f3186616640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f31800cd0b0 0x7f31800b0270 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.992+0000 7f3186616640 1 --2- 172.21.15.63:0/3957614278 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f31800b52a0 0x7f318014f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:37.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.992+0000 7f3186616640 1 -- 172.21.15.63:0/3957614278 >> 172.21.15.63:0/3957614278 conn(0x7f31800ceed0 msgr2=0x7f3180072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:37.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.992+0000 7f3186616640 1 -- 172.21.15.63:0/3957614278 shutdown_connections 2024-09-21T07:01:37.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:37.992+0000 7f3186616640 1 -- 172.21.15.63:0/3957614278 wait complete. 2024-09-21T07:01:38.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T07:01:38.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.120+0000 7f04684d5640 1 -- 172.21.15.63:0/579531276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448004e30 msgr2=0x7f044800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:38.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.120+0000 7f04684d5640 1 --2- 172.21.15.63:0/579531276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448004e30 0x7f044800b9c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0450001f00 tx=0x7f0448005830 comp rx=0 tx=0).stop 2024-09-21T07:01:38.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.120+0000 7f0466a72640 1 -- 172.21.15.63:0/579531276 reap_dead start 2024-09-21T07:01:38.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.120+0000 7f04684d5640 1 -- 172.21.15.63:0/579531276 shutdown_connections 2024-09-21T07:01:38.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.120+0000 7f04684d5640 1 -- 172.21.15.63:0/579531276 >> 172.21.15.63:0/579531276 conn(0x7f046006d3e0 msgr2=0x7f04600b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:38.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.120+0000 7f04684d5640 1 -- 172.21.15.63:0/579531276 shutdown_connections 2024-09-21T07:01:38.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.120+0000 7f04684d5640 1 -- 172.21.15.63:0/579531276 wait complete. 2024-09-21T07:01:38.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.122+0000 7f04684d5640 1 Processor -- start 2024-09-21T07:01:38.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.122+0000 7f04684d5640 1 -- start start 2024-09-21T07:01:38.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f04684d5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448004e30 0x7f0460151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:38.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f04684d5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046009a1b0 0x7f04601f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:38.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f04684d5640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04601f26f0 0x7f04601f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:38.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f04684d5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f04600b4c70 con 0x7f0448004e30 2024-09-21T07:01:38.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f04684d5640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f046015c250 con 0x7f046009a1b0 2024-09-21T07:01:38.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f04684d5640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f04600b4df0 con 0x7f04601f26f0 2024-09-21T07:01:38.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f0466271640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448004e30 0x7f0460151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:38.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f0466271640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448004e30 0x7f0460151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42884/0 (socket says 172.21.15.63:42884) 2024-09-21T07:01:38.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f0466271640 1 -- 172.21.15.63:0/1602134721 learned_addr learned my addr 172.21.15.63:0/1602134721 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:38.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f0466271640 1 -- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04601f26f0 msgr2=0x7f04601f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:38.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f0466271640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04601f26f0 0x7f04601f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f0466271640 1 -- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046009a1b0 msgr2=0x7f04601f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:38.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f0465a70640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046009a1b0 0x7f04601f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:38.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.123+0000 7f0466271640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046009a1b0 0x7f04601f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.124+0000 7f0466271640 1 -- 172.21.15.63:0/1602134721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046009a730 con 0x7f0448004e30 2024-09-21T07:01:38.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.124+0000 7f0465a70640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046009a1b0 0x7f04601f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T07:01:38.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.124+0000 7f0466271640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448004e30 0x7f0460151740 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0458006600 tx=0x7f04580039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:38.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.124+0000 7f045effd640 1 -- 172.21.15.63:0/1602134721 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458015070 con 0x7f0448004e30 2024-09-21T07:01:38.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.124+0000 7f045effd640 1 -- 172.21.15.63:0/1602134721 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0458011840 con 0x7f0448004e30 2024-09-21T07:01:38.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.124+0000 7f04684d5640 1 -- 172.21.15.63:0/1602134721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0460150c60 con 0x7f0448004e30 2024-09-21T07:01:38.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.124+0000 7f045effd640 1 -- 172.21.15.63:0/1602134721 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458011c50 con 0x7f0448004e30 2024-09-21T07:01:38.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.124+0000 7f04684d5640 1 -- 172.21.15.63:0/1602134721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0460151220 con 0x7f0448004e30 2024-09-21T07:01:38.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.125+0000 7f04684d5640 1 -- 172.21.15.63:0/1602134721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f046015ed80 con 0x7f0448004e30 2024-09-21T07:01:38.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.126+0000 7f045effd640 1 -- 172.21.15.63:0/1602134721 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0458018070 con 0x7f0448004e30 2024-09-21T07:01:38.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.126+0000 7f045effd640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f044c078bc0 0x7f044c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:38.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.126+0000 7f045effd640 1 -- 172.21.15.63:0/1602134721 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f045809b690 con 0x7f0448004e30 2024-09-21T07:01:38.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.126+0000 7f0465a70640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f044c078bc0 0x7f044c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:38.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.127+0000 7f0465a70640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f044c078bc0 0x7f044c07b0d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f046006a690 tx=0x7f0454011040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:38.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.131+0000 7f045effd640 1 -- 172.21.15.63:0/1602134721 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f0458063e00 con 0x7f0448004e30 2024-09-21T07:01:38.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.314+0000 7f04684d5640 1 -- 172.21.15.63:0/1602134721 --> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04600cf690 con 0x7f044c078bc0 2024-09-21T07:01:38.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.315+0000 7f045effd640 1 -- 172.21.15.63:0/1602134721 <== mgr.4114 v2:172.21.15.71:6800/3863064379 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13436 (secure 0 0 0) 0x7f04600cf690 con 0x7f044c078bc0 2024-09-21T07:01:38.317 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:38.317 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-09-21T07:01:38.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.317+0000 7f04684d5640 1 -- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f044c078bc0 msgr2=0x7f044c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:38.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.317+0000 7f04684d5640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f044c078bc0 0x7f044c07b0d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f046006a690 tx=0x7f0454011040 comp rx=0 tx=0).stop 2024-09-21T07:01:38.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.317+0000 7f04684d5640 1 -- 172.21.15.63:0/1602134721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448004e30 msgr2=0x7f0460151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:38.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.317+0000 7f04684d5640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448004e30 0x7f0460151740 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0458006600 tx=0x7f04580039c0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.317+0000 7f04684d5640 1 -- 172.21.15.63:0/1602134721 shutdown_connections 2024-09-21T07:01:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.317+0000 7f04684d5640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f044c078bc0 0x7f044c07b0d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.317+0000 7f04684d5640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f04601f26f0 0x7f04601f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.317+0000 7f04684d5640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f046009a1b0 0x7f04601f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.317+0000 7f04684d5640 1 --2- 172.21.15.63:0/1602134721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448004e30 0x7f0460151740 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.317+0000 7f04684d5640 1 -- 172.21.15.63:0/1602134721 >> 172.21.15.63:0/1602134721 conn(0x7f046006d3e0 msgr2=0x7f04600af040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.317+0000 7f04684d5640 1 -- 172.21.15.63:0/1602134721 shutdown_connections 2024-09-21T07:01:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.317+0000 7f04684d5640 1 -- 172.21.15.63:0/1602134721 wait complete. 2024-09-21T07:01:38.330 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-09-21T07:01:36.615817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220792,"kb_used_data":4552,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753928,"statfs":{"total":773094113280,"available":772868022272,"internally_reserved":0,"allocated":4661248,"data_stored":2545128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9180,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-81,"num_read_kb":-88,"num_write":-62,"num_write_kb":-29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001771"},"pg_stats":[{"pgid":"1.0","version":"38'74","reported_seq":150,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-21T07:01:35.106454+0000","last_change":"2024-09-21T07:01:35.106454+0000","last_active":"2024-09-21T07:01:35.106454+0000","last_peered":"2024-09-21T07:01:35.106454+0000","last_clean":"2024-09-21T07:01:35.106454+0000","last_became_active":"2024-09-21T07:00:12.588432+0000","last_became_peered":"2024-09-21T07:00:12.588432+0000","last_unstale":"2024-09-21T07:01:35.106454+0000","last_undegraded":"2024-09-21T07:01:35.106454+0000","last_fullsized":"2024-09-21T07:01:35.106454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'74","last_scrub_stamp":"2024-09-21T07:01:35.106330+0000","last_deep_scrub":"38'74","last_deep_scrub_stamp":"2024-09-21T07:01:35.106330+0000","last_clean_scrub_stamp":"2024-09-21T07:01:35.106330+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:45:07.244332+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":170549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":170549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509462,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1028096,"data_stored":760917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":170549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":170549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1028096,"data_stored":760917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":170549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":170549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T07:01:38.333 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T07:01:38.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.446+0000 7fd333d2b640 1 -- 172.21.15.63:0/58034716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd32c08c960 msgr2=0x7fd32c0d1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:38.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.446+0000 7fd333d2b640 1 --2- 172.21.15.63:0/58034716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd32c08c960 0x7fd32c0d1130 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd32c075390 tx=0x7fd32402a980 comp rx=0 tx=0).stop 2024-09-21T07:01:38.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.446+0000 7fd333d2b640 1 -- 172.21.15.63:0/58034716 shutdown_connections 2024-09-21T07:01:38.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.446+0000 7fd333d2b640 1 --2- 172.21.15.63:0/58034716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd32c08c960 0x7fd32c0d1130 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.446+0000 7fd333d2b640 1 --2- 172.21.15.63:0/58034716 >> v2:172.21.15.71:3300/0 conn(0x7fd32c0b9aa0 0x7fd32c0d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.446+0000 7fd333d2b640 1 --2- 172.21.15.63:0/58034716 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd32c0b3aa0 0x7fd32c0d2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.446+0000 7fd333d2b640 1 -- 172.21.15.63:0/58034716 >> 172.21.15.63:0/58034716 conn(0x7fd32c0d45e0 msgr2=0x7fd32c0d49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:38.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.447+0000 7fd333d2b640 1 -- 172.21.15.63:0/58034716 shutdown_connections 2024-09-21T07:01:38.449 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.447+0000 7fd333d2b640 1 -- 172.21.15.63:0/58034716 wait complete. 2024-09-21T07:01:38.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.448+0000 7fd333d2b640 1 Processor -- start 2024-09-21T07:01:38.450 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.448+0000 7fd333d2b640 1 -- start start 2024-09-21T07:01:38.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd333d2b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd32c08c960 0x7fd32c1f9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:38.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd333d2b640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd32c0b3aa0 0x7fd32c152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:38.452 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd333d2b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c0b9aa0 0x7fd32c0cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd333d2b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c06ed80 con 0x7fd32c08c960 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd333d2b640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c06ec00 con 0x7fd32c0b9aa0 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd333d2b640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c06ef00 con 0x7fd32c0b3aa0 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd331ac7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd32c08c960 0x7fd32c1f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd331ac7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd32c08c960 0x7fd32c1f9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39540/0 (socket says 172.21.15.63:39540) 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd331ac7640 1 -- 172.21.15.63:0/985282819 learned_addr learned my addr 172.21.15.63:0/985282819 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd3322c8640 1 --2- 172.21.15.63:0/985282819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c0b9aa0 0x7fd32c0cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd331ac7640 1 -- 172.21.15.63:0/985282819 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd32c0b3aa0 msgr2=0x7fd32c152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd331ac7640 1 --2- 172.21.15.63:0/985282819 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd32c0b3aa0 0x7fd32c152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd331ac7640 1 -- 172.21.15.63:0/985282819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c0b9aa0 msgr2=0x7fd32c0cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd331ac7640 1 --2- 172.21.15.63:0/985282819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c0b9aa0 0x7fd32c0cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd331ac7640 1 -- 172.21.15.63:0/985282819 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c1f9d60 con 0x7fd32c08c960 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd331ac7640 1 --2- 172.21.15.63:0/985282819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd32c08c960 0x7fd32c1f9820 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd32800c940 tx=0x7fd32800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd3227fc640 1 -- 172.21.15.63:0/985282819 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328004220 con 0x7fd32c08c960 2024-09-21T07:01:38.453 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd3227fc640 1 -- 172.21.15.63:0/985282819 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3280079b0 con 0x7fd32c08c960 2024-09-21T07:01:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd3227fc640 1 -- 172.21.15.63:0/985282819 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328007de0 con 0x7fd32c08c960 2024-09-21T07:01:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.450+0000 7fd333d2b640 1 -- 172.21.15.63:0/985282819 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c1f5ce0 con 0x7fd32c08c960 2024-09-21T07:01:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.451+0000 7fd333d2b640 1 -- 172.21.15.63:0/985282819 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c1f62a0 con 0x7fd32c08c960 2024-09-21T07:01:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.452+0000 7fd333d2b640 1 -- 172.21.15.63:0/985282819 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd32c0d2fd0 con 0x7fd32c08c960 2024-09-21T07:01:38.454 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.453+0000 7fd3227fc640 1 -- 172.21.15.63:0/985282819 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd328005030 con 0x7fd32c08c960 2024-09-21T07:01:38.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.453+0000 7fd3227fc640 1 --2- 172.21.15.63:0/985282819 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd310078b90 0x7fd31007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:38.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.453+0000 7fd3227fc640 1 -- 172.21.15.63:0/985282819 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7fd32809b240 con 0x7fd32c08c960 2024-09-21T07:01:38.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.453+0000 7fd3312c6640 1 --2- 172.21.15.63:0/985282819 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd310078b90 0x7fd31007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:38.455 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.454+0000 7fd3312c6640 1 --2- 172.21.15.63:0/985282819 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd310078b90 0x7fd31007b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd32c162530 tx=0x7fd31c005bd0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:38.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.457+0000 7fd3227fc640 1 -- 172.21.15.63:0/985282819 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7fd32c1f9d60 con 0x7fd32c08c960 2024-09-21T07:01:38.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.642+0000 7fd333d2b640 1 -- 172.21.15.63:0/985282819 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fd32c0b32f0 con 0x7fd32c08c960 2024-09-21T07:01:38.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.646+0000 7fd3227fc640 1 -- 172.21.15.63:0/985282819 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v34)=0 v34) ==== 123+0+0 (secure 0 0 0) 0x7fd328014070 con 0x7fd32c08c960 2024-09-21T07:01:38.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.647+0000 7fd3227fc640 1 -- 172.21.15.63:0/985282819 <== mon.0 v2:172.21.15.63:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fd328062ea0 con 0x7fd32c08c960 2024-09-21T07:01:38.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.649+0000 7fd333d2b640 1 -- 172.21.15.63:0/985282819 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd310078b90 msgr2=0x7fd31007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:38.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.649+0000 7fd333d2b640 1 --2- 172.21.15.63:0/985282819 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd310078b90 0x7fd31007b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd32c162530 tx=0x7fd31c005bd0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.649+0000 7fd333d2b640 1 -- 172.21.15.63:0/985282819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd32c08c960 msgr2=0x7fd32c1f9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:38.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.649+0000 7fd333d2b640 1 --2- 172.21.15.63:0/985282819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd32c08c960 0x7fd32c1f9820 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd32800c940 tx=0x7fd32800ce00 comp rx=0 tx=0).stop 2024-09-21T07:01:38.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.649+0000 7fd333d2b640 1 -- 172.21.15.63:0/985282819 shutdown_connections 2024-09-21T07:01:38.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.649+0000 7fd333d2b640 1 --2- 172.21.15.63:0/985282819 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7fd310078b90 0x7fd31007b0a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.649+0000 7fd333d2b640 1 --2- 172.21.15.63:0/985282819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd32c0b9aa0 0x7fd32c0cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.649+0000 7fd333d2b640 1 --2- 172.21.15.63:0/985282819 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7fd32c0b3aa0 0x7fd32c152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.649+0000 7fd333d2b640 1 --2- 172.21.15.63:0/985282819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd32c08c960 0x7fd32c1f9820 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.649+0000 7fd333d2b640 1 -- 172.21.15.63:0/985282819 >> 172.21.15.63:0/985282819 conn(0x7fd32c0d45e0 msgr2=0x7fd32c0b8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:38.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.649+0000 7fd333d2b640 1 -- 172.21.15.63:0/985282819 shutdown_connections 2024-09-21T07:01:38.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.649+0000 7fd333d2b640 1 -- 172.21.15.63:0/985282819 wait complete. 2024-09-21T07:01:38.661 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T07:01:38.662 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-21T07:01:38.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.776+0000 7f91d1d90640 1 -- 172.21.15.63:0/258032865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91cc15ef00 msgr2=0x7f91cc0d2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:38.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.776+0000 7f91d1d90640 1 --2- 172.21.15.63:0/258032865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91cc15ef00 0x7f91cc0d2a70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f91cc08d550 tx=0x7f91c002a5f0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.776+0000 7f91d1d90640 1 -- 172.21.15.63:0/258032865 shutdown_connections 2024-09-21T07:01:38.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.776+0000 7f91d1d90640 1 --2- 172.21.15.63:0/258032865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91cc15ef00 0x7f91cc0d2a70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.776+0000 7f91d1d90640 1 --2- 172.21.15.63:0/258032865 >> v2:172.21.15.71:3300/0 conn(0x7f91cc0b7530 0x7f91cc0d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.776+0000 7f91d1d90640 1 -- 172.21.15.63:0/258032865 >> 172.21.15.63:0/258032865 conn(0x7f91cc08bfd0 msgr2=0x7f91cc0d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:38.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.776+0000 7f91d1d90640 1 -- 172.21.15.63:0/258032865 shutdown_connections 2024-09-21T07:01:38.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.776+0000 7f91d1d90640 1 -- 172.21.15.63:0/258032865 wait complete. 2024-09-21T07:01:38.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.778+0000 7f91d1d90640 1 Processor -- start 2024-09-21T07:01:38.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.778+0000 7f91d1d90640 1 -- start start 2024-09-21T07:01:38.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.779+0000 7f91d1d90640 1 --2- >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91cc0b2650 0x7f91cc1529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:38.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.779+0000 7f91d1d90640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91cc0b7530 0x7f91cc15daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:38.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.779+0000 7f91d1d90640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91cc15ef00 0x7f91cc15dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:38.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.779+0000 7f91d1d90640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc0b3500 con 0x7f91cc0b7530 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.779+0000 7f91d1d90640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc0b3380 con 0x7f91cc15ef00 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.779+0000 7f91d1d90640 1 -- --> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] -- mon_getmap magic: 0 -- 0x7f91cc0d0320 con 0x7f91cc0b2650 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.779+0000 7f91caffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91cc0b7530 0x7f91cc15daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.779+0000 7f91caffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91cc0b7530 0x7f91cc15daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39552/0 (socket says 172.21.15.63:39552) 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.779+0000 7f91caffd640 1 -- 172.21.15.63:0/729343846 learned_addr learned my addr 172.21.15.63:0/729343846 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.780+0000 7f91cb7fe640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91cc0b2650 0x7f91cc1529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.780+0000 7f91cbfff640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91cc15ef00 0x7f91cc15dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.780+0000 7f91caffd640 1 -- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91cc0b2650 msgr2=0x7f91cc1529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.780+0000 7f91caffd640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91cc0b2650 0x7f91cc1529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.780+0000 7f91caffd640 1 -- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91cc15ef00 msgr2=0x7f91cc15dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.780+0000 7f91caffd640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91cc15ef00 0x7f91cc15dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.780+0000 7f91caffd640 1 -- 172.21.15.63:0/729343846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91cc0ca2c0 con 0x7f91cc0b7530 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.780+0000 7f91caffd640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91cc0b7530 0x7f91cc15daa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f91c0034040 tx=0x7f91c0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.780+0000 7f91b3fff640 1 -- 172.21.15.63:0/729343846 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c003e030 con 0x7f91cc0b7530 2024-09-21T07:01:38.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.780+0000 7f91b3fff640 1 -- 172.21.15.63:0/729343846 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f91c0004730 con 0x7f91cc0b7530 2024-09-21T07:01:38.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.780+0000 7f91d1d90640 1 -- 172.21.15.63:0/729343846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91cc152ee0 con 0x7f91cc0b7530 2024-09-21T07:01:38.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.780+0000 7f91b3fff640 1 -- 172.21.15.63:0/729343846 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0035040 con 0x7f91cc0b7530 2024-09-21T07:01:38.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.780+0000 7f91d1d90640 1 -- 172.21.15.63:0/729343846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91cc0c9010 con 0x7f91cc0b7530 2024-09-21T07:01:38.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.781+0000 7f91d1d90640 1 -- 172.21.15.63:0/729343846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91cc0b2a60 con 0x7f91cc0b7530 2024-09-21T07:01:38.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.782+0000 7f91b3fff640 1 -- 172.21.15.63:0/729343846 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f91c0041030 con 0x7f91cc0b7530 2024-09-21T07:01:38.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.783+0000 7f91b3fff640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f91b8078bc0 0x7f91b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T07:01:38.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.783+0000 7f91b3fff640 1 -- 172.21.15.63:0/729343846 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5029+0+0 (secure 0 0 0) 0x7f91c00bb190 con 0x7f91cc0b7530 2024-09-21T07:01:38.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.783+0000 7f91cb7fe640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f91b8078bc0 0x7f91b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T07:01:38.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.783+0000 7f91cb7fe640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f91b8078bc0 0x7f91b807b0d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0d4660 tx=0x7f91bc005f90 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T07:01:38.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:38.787+0000 7f91b3fff640 1 -- 172.21.15.63:0/729343846 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (secure 0 0 0) 0x7f91c0083340 con 0x7f91cc0b7530 2024-09-21T07:01:39.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.015+0000 7f91d1d90640 1 -- 172.21.15.63:0/729343846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91cc06a130 con 0x7f91cc0b7530 2024-09-21T07:01:39.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.016+0000 7f91b3fff640 1 -- 172.21.15.63:0/729343846 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+3905 (secure 0 0 0) 0x7f91c0087d70 con 0x7f91cc0b7530 2024-09-21T07:01:39.018 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-09-21T07:01:39.018 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"btime":"2024-09-21T07:01:27:690844+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4831,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6836/585708774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":585708774},{"type":"v1","addr":"172.21.15.71:6836","nonce":585708774}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4837,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/2545148827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6835","nonce":2545148827},{"type":"v1","addr":"172.21.15.71:6837","nonce":2545148827}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4899,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6834/2618757202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2618757202},{"type":"v1","addr":"172.21.15.63:6834","nonce":2618757202}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6835/815771185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6833","nonce":815771185},{"type":"v1","addr":"172.21.15.63:6835","nonce":815771185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[]} 2024-09-21T07:01:39.018 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 27 2024-09-21T07:01:39.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.018+0000 7f91d1d90640 1 -- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f91b8078bc0 msgr2=0x7f91b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:39.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.018+0000 7f91d1d90640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f91b8078bc0 0x7f91b807b0d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0d4660 tx=0x7f91bc005f90 comp rx=0 tx=0).stop 2024-09-21T07:01:39.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.018+0000 7f91d1d90640 1 -- 172.21.15.63:0/729343846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91cc0b7530 msgr2=0x7f91cc15daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T07:01:39.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.018+0000 7f91d1d90640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91cc0b7530 0x7f91cc15daa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f91c0034040 tx=0x7f91c0003c10 comp rx=0 tx=0).stop 2024-09-21T07:01:39.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.018+0000 7f91d1d90640 1 -- 172.21.15.63:0/729343846 shutdown_connections 2024-09-21T07:01:39.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.018+0000 7f91d1d90640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:6800/3863064379,v1:172.21.15.71:6801/3863064379] conn(0x7f91b8078bc0 0x7f91b807b0d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:39.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.018+0000 7f91d1d90640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91cc15ef00 0x7f91cc15dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:39.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.018+0000 7f91d1d90640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91cc0b7530 0x7f91cc15daa0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:39.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.018+0000 7f91d1d90640 1 --2- 172.21.15.63:0/729343846 >> [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] conn(0x7f91cc0b2650 0x7f91cc1529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T07:01:39.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.018+0000 7f91d1d90640 1 -- 172.21.15.63:0/729343846 >> 172.21.15.63:0/729343846 conn(0x7f91cc08bfd0 msgr2=0x7f91cc0d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T07:01:39.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.018+0000 7f91d1d90640 1 -- 172.21.15.63:0/729343846 shutdown_connections 2024-09-21T07:01:39.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-09-21T07:01:39.018+0000 7f91d1d90640 1 -- 172.21.15.63:0/729343846 wait complete. 2024-09-21T07:01:39.031 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-21T07:01:39.031 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T07:01:39.031 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-21T07:01:39.032 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.044 INFO:tasks.ceph.mds.a:Stopped 2024-09-21T07:01:39.044 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-21T07:01:39.044 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.094 INFO:tasks.ceph.mds.c:Stopped 2024-09-21T07:01:39.095 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-21T07:01:39.095 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.106 INFO:tasks.ceph.mds.b:Stopped 2024-09-21T07:01:39.107 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-21T07:01:39.107 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.159 INFO:tasks.ceph.mds.d:Stopped 2024-09-21T07:01:39.159 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T07:01:39.159 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T07:01:39.159 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.195 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T07:01:39.195 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T07:01:39.195 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.263 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T07:01:39.263 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T07:01:39.263 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.328 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T07:01:39.329 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T07:01:39.329 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.396 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T07:01:39.396 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-21T07:01:39.396 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.428 INFO:tasks.ceph.osd.4:Stopped 2024-09-21T07:01:39.428 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-21T07:01:39.428 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.498 INFO:tasks.ceph.osd.5:Stopped 2024-09-21T07:01:39.498 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-21T07:01:39.499 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.568 INFO:tasks.ceph.osd.6:Stopped 2024-09-21T07:01:39.569 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-21T07:01:39.569 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.647 INFO:tasks.ceph.osd.7:Stopped 2024-09-21T07:01:39.647 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T07:01:39.648 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-21T07:01:39.648 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.674 INFO:tasks.ceph.mgr.y:Stopped 2024-09-21T07:01:39.675 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T07:01:39.675 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.720 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T07:01:39.720 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T07:01:39.720 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T07:01:39.720 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.731 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T07:01:39.732 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T07:01:39.732 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.773 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T07:01:39.773 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T07:01:39.773 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T07:01:39.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-21T07:01:39.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-21T07:01:39.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-21T07:01:39.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-21T07:01:39.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-21T07:01:39.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-21T07:01:39.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-21T07:01:39.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-21T07:01:39.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-21T07:01:39.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-21T07:01:39.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-21T07:01:39.827 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T07:01:39.827 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T07:01:39.827 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T07:01:39.866 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T07:01:39.867 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T07:01:40.029 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T07:01:40.029 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T07:01:40.128 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T07:01:40.128 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T07:01:40.195 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T07:01:40.195 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T07:01:40.244 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T07:01:40.244 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-21T07:01:40.394 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T07:01:40.394 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-21T07:01:40.481 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T07:01:40.481 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-21T07:01:40.554 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T07:01:40.555 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-21T07:01:40.604 INFO:tasks.ceph:Archiving mon data... 2024-09-21T07:01:40.605 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913577/data/mon.a.tgz 2024-09-21T07:01:40.606 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-09-21T07:01:40.622 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.zqZVdBwWwp 2024-09-21T07:01:40.622 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.zqZVdBwWwp 2024-09-21T07:01:40.762 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.zqZVdBwWwp 2024-09-21T07:01:40.846 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.zqZVdBwWwp is 300KB 2024-09-21T07:01:40.940 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.zqZVdBwWwp 2024-09-21T07:01:40.956 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913577/data/mon.b.tgz 2024-09-21T07:01:40.956 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-21T07:01:40.973 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.ifU9yyrlgF 2024-09-21T07:01:40.974 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ifU9yyrlgF 2024-09-21T07:01:41.120 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.ifU9yyrlgF 2024-09-21T07:01:41.203 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.ifU9yyrlgF is 401KB 2024-09-21T07:01:41.299 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.ifU9yyrlgF 2024-09-21T07:01:41.314 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913577/data/mon.c.tgz 2024-09-21T07:01:41.314 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-09-21T07:01:41.368 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.8ckg8vDc5R 2024-09-21T07:01:41.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.8ckg8vDc5R 2024-09-21T07:01:41.504 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.8ckg8vDc5R 2024-09-21T07:01:41.586 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.8ckg8vDc5R is 401KB 2024-09-21T07:01:41.682 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.8ckg8vDc5R 2024-09-21T07:01:41.696 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T07:01:41.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T07:01:41.699 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T07:01:41.778 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T07:01:41.817 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T07:01:41.817 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T07:01:41.818 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913577/remote/smithi063/crash 2024-09-21T07:01:41.819 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T07:01:41.844 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913577/remote/smithi071/crash 2024-09-21T07:01:41.844 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T07:01:41.881 INFO:tasks.ceph:Shutting down logrotate 2024-09-21T07:01:41.881 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:01:41.887 DEBUG:teuthology.orchestra.run.smithi071:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-21T07:01:41.976 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T07:01:42.002 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-21T07:01:42.026 INFO:tasks.ceph:Compressing logs... 2024-09-21T07:01:42.026 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:01:42.044 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T07:01:42.066 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T07:01:42.068 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50849.log 2024-09-21T07:01:42.069 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47523.log 2024-09-21T07:01:42.069 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44106.log 2024-09-21T07:01:42.069 INFO:teuthology.orchestra.run.smithi063.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.50849.log.gz 2024-09-21T07:01:42.069 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42995.log 2024-09-21T07:01:42.069 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47523.log.gz 2024-09-21T07:01:42.069 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50765.log 2024-09-21T07:01:42.069 INFO:teuthology.orchestra.run.smithi063.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.44106.log.gz 2024-09-21T07:01:42.069 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44695.log 2024-09-21T07:01:42.069 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49065.log 2024-09-21T07:01:42.069 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42995.log.gz 2024-09-21T07:01:42.069 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2%/var/log/ceph/ceph-client.admin.44695.log: -- replaced with /var/log/ceph/ceph-client.admin.50765.log.gz 2024-09-21T07:01:42.069 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46719.log 2024-09-21T07:01:42.069 INFO:teuthology.orchestra.run.smithi063.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.44695.log.gz 2024-09-21T07:01:42.112 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42845.log 2024-09-21T07:01:42.112 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-21T07:01:42.112 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.3.42845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36810.log 2024-09-21T07:01:42.112 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42845.log.gz 2024-09-21T07:01:42.112 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36650.log 2024-09-21T07:01:42.112 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36810.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-21T07:01:42.112 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36650.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36810.log.gz 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36690.log 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36650.log.gz 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36690.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.4.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36690.log.gz 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36730.log 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36610.log 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36770.log 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36610.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36730.log.gz 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42447.log 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36610.log.gz 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36770.log: gzip -5 --verbose -- 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36770.log.gz 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr: /var/log/ceph/ceph-osd.6.log 2024-09-21T07:01:42.113 INFO:teuthology.orchestra.run.smithi071.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T07:01:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.1.42447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42447.log.gz 2024-09-21T07:01:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-21T07:01:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T07:01:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36530.log 2024-09-21T07:01:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-21T07:01:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36530.log: 91.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T07:01:42.114 INFO:teuthology.orchestra.run.smithi071.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36530.log.gz 2024-09-21T07:01:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-21T07:01:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-21T07:01:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mgr.x.log: 91.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-21T07:01:42.114 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36570.log 2024-09-21T07:01:42.116 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.36570.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36570.log.gz 2024-09-21T07:01:42.140 INFO:teuthology.orchestra.run.smithi071.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T07:01:42.145 INFO:teuthology.orchestra.run.smithi071.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-21T07:01:42.149 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44119.log 2024-09-21T07:01:42.149 INFO:teuthology.orchestra.run.smithi063.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49065.log.gz 2024-09-21T07:01:42.150 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46093.log 2024-09-21T07:01:42.150 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46719.log.gz 2024-09-21T07:01:42.150 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43519.log 2024-09-21T07:01:42.150 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44119.log.gz 2024-09-21T07:01:42.150 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43561.log 2024-09-21T07:01:42.150 INFO:teuthology.orchestra.run.smithi063.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46093.log.gz 2024-09-21T07:01:42.150 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44447.log 2024-09-21T07:01:42.150 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43561.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43519.log.gz 2024-09-21T07:01:42.150 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43477.log 2024-09-21T07:01:42.150 INFO:teuthology.orchestra.run.smithi063.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43561.log.gz 2024-09-21T07:01:42.150 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36787.log 2024-09-21T07:01:42.150 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44447.log.gz 2024-09-21T07:01:42.150 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50931.log 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36787.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43477.log.gz 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46642.log 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.36787.log.gz 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43603.log 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50931.log.gz 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46261.log 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43603.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46642.log.gz 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43603.log.gz 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43897.log 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46261.log.gz 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46761.log 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44452.log 2024-09-21T07:01:42.151 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43897.log.gz 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47481.log 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46761.log.gz 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47933.log 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44452.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44452.log.gz 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44455.log 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47481.log.gz 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47649.log 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47933.log: /var/log/ceph/ceph-client.admin.44455.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47933.log.gz 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46552.log 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44455.log.gz 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49589.log 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47649.log: /var/log/ceph/ceph-client.admin.46552.log: gzip -5 --verbose 87.5% -- /var/log/ceph/ceph-client.admin.42521.log -- replaced with /var/log/ceph/ceph-client.admin.47649.log.gz 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46552.log.gz 2024-09-21T07:01:42.152 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47151.log 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.42521.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49589.log.gz 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36621.log 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42521.log.gz 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44905.log 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr: 87.0%/var/log/ceph/ceph-client.admin.36621.log: -- replaced with /var/log/ceph/ceph-client.admin.47151.log.gz 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr: 77.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36621.log.gz 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46219.log 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49631.log 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44905.log.gz 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47887.log 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46219.log.gz 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47565.log 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49631.log: /var/log/ceph/ceph-client.admin.47887.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49631.log.gz 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45875.log 2024-09-21T07:01:42.153 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47887.log.gz 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47231.log 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47565.log: /var/log/ceph/ceph-client.2.45875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45875.log.gz 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48977.log 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47565.log.gz 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49505.log 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48977.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47231.log.gz 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37721.log 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48977.log.gz 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44120.log 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49505.log.gz 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44121.log 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37721.log.gz 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50681.log 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44120.log.gz 2024-09-21T07:01:42.154 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46177.log 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44121.log.gz 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43077.log 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50681.log.gz 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36565.log 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46177.log.gz 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44947.log 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36565.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43077.log.gz 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36565.log.gz 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49692.log 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43137.log 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36452.log 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49692.log.gz 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.admin.43137.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43393.log 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44947.log.gz 2024-09-21T07:01:42.155 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43137.log.gz 2024-09-21T07:01:42.156 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49776.log 2024-09-21T07:01:42.157 INFO:teuthology.orchestra.run.smithi063.stderr: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.36452.log.gz 2024-09-21T07:01:42.157 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49243.log 2024-09-21T07:01:42.157 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43393.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43393.log.gz 2024-09-21T07:01:42.157 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47058.log 2024-09-21T07:01:42.157 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49776.log.gz 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49243.log: /var/log/ceph/ceph-client.admin.47058.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49243.log.gz 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44445.log 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47058.log.gz 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46009.log 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.44445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47014.log 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48395.log 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46009.log.gz 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48101.log 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47014.log: /var/log/ceph/ceph-client.admin.48395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46363.log 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47014.log.gz 2024-09-21T07:01:42.158 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49734.log 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48101.log.gz 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48395.log.gz 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36509.log 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46363.log: /var/log/ceph/ceph-client.admin.49734.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46363.log.gz 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43435.log 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49734.log.gz 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49019.log 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36509.log.gz 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45085.log 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43435.log.gz 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50387.log 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49019.log.gz 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44117.log 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45085.log.gz 2024-09-21T07:01:42.159 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49337.log 2024-09-21T07:01:42.160 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50387.log.gz 2024-09-21T07:01:42.160 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43179.log 2024-09-21T07:01:42.160 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44117.log: /var/log/ceph/ceph-client.admin.49337.log: gzip 87.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.44117.log.gz --verbose 2024-09-21T07:01:42.160 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.37067.log 2024-09-21T07:01:42.160 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49337.log.gz 2024-09-21T07:01:42.160 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50429.log 2024-09-21T07:01:42.160 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37067.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43179.log.gz 2024-09-21T07:01:42.160 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47752.log 2024-09-21T07:01:42.160 INFO:teuthology.orchestra.run.smithi063.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37067.log.gz 2024-09-21T07:01:42.160 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48017.log 2024-09-21T07:01:42.160 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47752.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50429.log.gz 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50513.log 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47752.log.gz 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48017.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48017.log.gz 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50639.log 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50513.log.gz 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48059.log 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47439.log 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50639.log.gz 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49463.log/var/log/ceph/ceph-client.admin.48059.log: 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47439.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48059.log.gz 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48143.log 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47439.log.gz 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49421.log 2024-09-21T07:01:42.161 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49463.log.gz 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46803.log 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48143.log.gz 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47803.log 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49421.log.gz 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49547.log 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46803.log.gz 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.admin.47803.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42899.log 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44115.log 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47803.log.gz 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49547.log: /var/log/ceph/ceph-client.admin.42899.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49547.log.gz 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48185.log 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42899.log.gz 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50597.log 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48185.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44115.log.gz 2024-09-21T07:01:42.162 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45571.log 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48185.log.gz 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44456.log 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.45571.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50597.log.gz 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46845.log 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45571.log.gz 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44456.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46929.log 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44456.log.gz 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46845.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50009.log 87.7% 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46845.log.gz 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43309.log 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5%/var/log/ceph/ceph-client.admin.50009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47395.log 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46929.log.gz 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50009.log.gz 2024-09-21T07:01:42.163 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37031.log 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43309.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46303.log 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47395.log: /var/log/ceph/ceph-client.admin.37031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50889.log 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47395.log.gz 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46303.log: 86.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.37031.log.gz -5 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50261.log 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46303.log.gz 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50889.log: /var/log/ceph/ceph-client.admin.50261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48227.log 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50889.log.gz 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50261.log.gz 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37087.log 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46887.log: /var/log/ceph/ceph-client.admin.48227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36904.log 2024-09-21T07:01:42.164 INFO:teuthology.orchestra.run.smithi063.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48227.log.gz/var/log/ceph/ceph-client.admin.37087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48461.log 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37087.log.gz 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36739.log 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36904.log.gz 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48461.log: /var/log/ceph/ceph-client.admin.36739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50219.log 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.2.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36739.log.gz 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50303.log 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3%/var/log/ceph/ceph-client.admin.50219.log: -- replaced with /var/log/ceph/ceph-client.admin.48461.log.gz 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50219.log.gz 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.37063.log 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50303.log: gzip -5 --verbose -- 87.2% /var/log/ceph/ceph-client.admin.43939.log 2024-09-21T07:01:42.165 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50303.log.gz 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47975.log 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.37063.log.gz 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46051.log 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43939.log: /var/log/ceph/ceph-client.admin.47975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50135.log 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43939.log.gz 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46051.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47975.log.gz 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48353.log 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46051.log.gz 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50093.log 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50135.log: gzip/var/log/ceph/ceph-client.admin.48353.log: -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30409.log 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50093.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48353.log.gz 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50135.log.gz 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr:gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50093.log.gz 2024-09-21T07:01:42.166 INFO:teuthology.orchestra.run.smithi063.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50177.log 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.tmp-client.admin.30409.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30409.log.gz 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43813.log 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36855.log 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50177.log.gz 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43813.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43813.log.gz 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.50555.log 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36855.log: gzip -5 --verbose 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36855.log.gz 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-mgr.y.log 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44118.log 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50555.log.gz 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46474.log 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48311.log 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44118.log.gz 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46971.log 2024-09-21T07:01:42.167 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48311.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46474.log.gz 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48311.log.gz 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43267.log 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.46971.log: /var/log/ceph/ceph.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46971.log.gz 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44863.log 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr: 83.9%/var/log/ceph/ceph-client.admin.43267.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43267.log.gz 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50471.log 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43855.log 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47607.log 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44863.log.gz 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr: 87.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44449.log 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50471.log.gz 2024-09-21T07:01:42.168 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43855.log: /var/log/ceph/ceph-client.admin.47607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49107.log 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43855.log.gz 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5%/var/log/ceph/ceph-client.admin.44449.log: -- replaced with /var/log/ceph/ceph-client.admin.47607.log.gz 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44442.log 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44449.log.gz 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43223.log 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49107.log: /var/log/ceph/ceph-client.admin.44442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36814.log 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43223.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44442.log.gz 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49107.log.gz 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43223.log.gz 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49818.log 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.36814.log: /var/log/ceph/ceph-client.admin.48906.log 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49818.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36814.log.gz 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50807.log 2024-09-21T07:01:42.169 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49818.log.gz 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36593.log 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48906.log: /var/log/ceph/ceph-client.admin.50807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47708.log 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36593.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50807.log.gz 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48906.log.gz 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36593.log.gz 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43687.log 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36536.log 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47708.log: /var/log/ceph/ceph-client.admin.43687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44821.log 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36536.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.47708.log.gz 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43687.log.gz 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr: 76.5% -- replaced with /var/log/ceph/ceph-client.admin.36536.log.gz 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37102.log 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44737.log 2024-09-21T07:01:42.170 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44821.log: /var/log/ceph/ceph-client.admin.37102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37105.log 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44821.log.gz 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44737.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.37102.log.gz 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44737.log.gz 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47109.log 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50723.log 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37105.log: gzip/var/log/ceph/ceph-client.admin.47109.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37395.log 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.37105.log.gz 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47109.log.gz 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45435.log 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49379.log 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50723.log.gz 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37395.log.gz/var/log/ceph/ceph-client.0.45435.log: 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45435.log.gz 2024-09-21T07:01:42.171 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43729.log 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.49379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48269.log 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49379.log.gz 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43729.log: gzip -5 --verbose -- 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43729.log.gz 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.50345.log 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48269.log: gzip -5 --verbose -- 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48269.log.gz 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.37636.log 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50051.log 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50345.log.gz 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37435.log 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37636.log.gz 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47311.log 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.50051.log: /var/log/ceph/ceph-client.admin.37435.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50051.log.gz 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37435.log.gz 2024-09-21T07:01:42.172 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47845.log 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44457.log 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47845.log: /var/log/ceph/ceph-client.admin.47311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43351.log 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47845.log.gz 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36657.log 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47311.log.gz 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44457.log.gz 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44653.log 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48761.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43351.log.gz 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr: 76.1% -- replaced with /var/log/ceph/ceph-client.admin.36657.log.gz 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.44653.log: /var/log/ceph/ceph-client.admin.44113.log 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48761.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44653.log.gz 2024-09-21T07:01:42.173 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44779.log 86.8% -- replaced with /var/log/ceph/ceph-client.admin.48761.log.gz 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44113.log: gzip -5 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44113.log.gz 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.44779.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44779.log.gz 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48803.log 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37059.log 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36994.log 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48803.log.gz 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37059.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43645.log 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.37059.log.gz/var/log/ceph/ceph-client.admin.36994.log: 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46135.log 2024-09-21T07:01:42.174 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43771.log 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36994.log.gz 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43645.log: /var/log/ceph/ceph-client.admin.46135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37115.log 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr: 87.0% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46135.log.gz 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43645.log.gz 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.43771.log: gzip -5 --verbose -- 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43771.log.gz 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr: /var/log/ceph/ceph-client.admin.37064.log 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37115.log: gzip -5 --verbose 85.6% -- /var/log/ceph/ceph-client.admin.47353.log 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37115.log.gz 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.37064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48864.log 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.37064.log.gz 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.47353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48649.log 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47353.log.gz 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.48864.log: /var/log/ceph/ceph-client.0.48649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48649.log.gz 2024-09-21T07:01:42.175 INFO:teuthology.orchestra.run.smithi063.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48864.log.gz 2024-09-21T07:01:42.177 INFO:teuthology.orchestra.run.smithi071.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-21T07:01:42.179 INFO:teuthology.orchestra.run.smithi071.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-21T07:01:42.181 INFO:teuthology.orchestra.run.smithi063.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T07:01:42.193 INFO:teuthology.orchestra.run.smithi063.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T07:01:42.198 INFO:teuthology.orchestra.run.smithi071.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-21T07:01:42.201 INFO:teuthology.orchestra.run.smithi071.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-21T07:01:42.215 INFO:teuthology.orchestra.run.smithi071.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-21T07:01:42.221 INFO:teuthology.orchestra.run.smithi063.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T07:01:42.231 INFO:teuthology.orchestra.run.smithi071.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-21T07:01:42.232 INFO:teuthology.orchestra.run.smithi063.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T07:01:42.233 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-21T07:01:42.233 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m0.150s 2024-09-21T07:01:42.233 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m0.696s 2024-09-21T07:01:42.233 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m0.049s 2024-09-21T07:01:42.254 INFO:teuthology.orchestra.run.smithi063.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T07:01:42.256 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-09-21T07:01:42.256 INFO:teuthology.orchestra.run.smithi063.stderr:real 0m0.200s 2024-09-21T07:01:42.256 INFO:teuthology.orchestra.run.smithi063.stderr:user 0m0.709s 2024-09-21T07:01:42.256 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m0.148s 2024-09-21T07:01:42.257 INFO:tasks.ceph:Archiving logs... 2024-09-21T07:01:42.257 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913577/remote/smithi063/log 2024-09-21T07:01:42.258 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:01:42.528 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913577/remote/smithi071/log 2024-09-21T07:01:42.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T07:01:42.648 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T07:01:42.672 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T07:01:42.673 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:01:42.675 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T07:01:42.748 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T07:01:42.757 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T07:01:42.757 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:01:42.759 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T07:01:42.772 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:01:42.773 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-21T07:01:42.776 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:01:42.776 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-09-21T07:01:42.776 INFO:teuthology.orchestra.run.smithi063.stdout:^* hv01.front.sepia.ceph.com 3 6 177 45 -4129ns[ -19us] +/- 49ms 2024-09-21T07:01:42.776 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 45 -47us[ -47us] +/- 59ms 2024-09-21T07:01:42.776 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 45 +84us[ +84us] +/- 76ms 2024-09-21T07:01:42.776 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:01:42.778 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T07:01:42.778 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-21T07:01:42.778 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv01.front.sepia.ceph.com 3 6 177 44 +24us[ +27us] +/- 49ms 2024-09-21T07:01:42.778 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 45 -48us[ -44us] +/- 59ms 2024-09-21T07:01:42.778 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 45 +72us[ +75us] +/- 76ms 2024-09-21T07:01:42.778 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T07:01:42.778 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T07:01:42.787 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T07:01:42.787 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T07:01:42.795 DEBUG:teuthology.orchestra.run.smithi063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T07:01:42.885 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T07:01:42.947 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T07:01:42.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:01:42.976 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T07:01:43.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:01:43.003 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T07:01:43.012 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T07:01:43.021 INFO:teuthology.task.internal:Duration was 473.465368 seconds 2024-09-21T07:01:43.021 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T07:01:43.030 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T07:01:43.030 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:01:43.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T07:01:43.070 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:01:43.082 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T07:01:43.475 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T07:01:43.475 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-09-21T07:01:43.475 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:01:43.539 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-09-21T07:01:43.540 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T07:01:43.579 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T07:01:43.579 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:01:43.582 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T07:01:43.646 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T07:01:43.646 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:01:43.651 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T07:01:43.787 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T07:01:43.799 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T07:01:43.799 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:01:43.825 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T07:01:43.849 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T07:01:43.859 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:01:43.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:01:43.889 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-09-21T07:01:43.912 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-09-21T07:01:43.926 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:01:43.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:01:43.959 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T07:01:43.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T07:01:43.978 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T07:01:43.988 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T07:01:43.989 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913577/remote/smithi063 2024-09-21T07:01:43.989 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:01:44.034 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913577/remote/smithi071 2024-09-21T07:01:44.035 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T07:01:44.067 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T07:01:44.067 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:01:44.072 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T07:01:44.118 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T07:01:44.129 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T07:01:44.129 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T07:01:44.139 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T07:01:44.139 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:01:44.141 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T07:01:44.154 INFO:teuthology.orchestra.run.smithi063.stdout: 265336 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:01 /home/ubuntu/cephtest 2024-09-21T07:01:44.172 INFO:teuthology.orchestra.run.smithi071.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 07:01 /home/ubuntu/cephtest 2024-09-21T07:01:44.173 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T07:01:44.183 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T07:01:44.205 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/recovery-fs} duration: 473.46536779403687 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T07:01:44.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T07:01:44.284 INFO:teuthology.run:pass